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INTRODUCTION 

The 1130 Statistical System contains four major analysis programs: 

1. Stepwise Linear Regression 

2. Factor Analysis 

3. Analysis of Variance 

4. Polynomial Fitting with Orthogonal Polynomials 

Each of these analysis programs is composed of a number of subroutines, which are 
stored on the disk and are called into core storage when required for the execution of a 
particular job. The logic flow of the programs and the type of analysis to be performed 
is controlled by a main program , which reads the user-supplied parameter cards and 
calls in the appropriate link at the proper time. 

Although the programs imply different techniques, a common approach can be used in 
executing a job for any analysis. Chapter 2 of this manual is divided into four parts 
that describe completely the necessary parameters and monitor control cards for 
execution . 

Special features available with this package provide added user flexibility: 

In all four major programs, data card formats can be specified by the user. 

• Stepwise Linear Regression . Matrix input and output are allowed with a pooling 
option which provides for the combining of raw cross products matrices, either by 
addition or subtraction. This allows the combining of input from different sources, 
or of input that is available at different times , without requiring recalculation of 
these matrices. The subtraction feature gives flexibility for the handling of outlyers. 
Residuals are available on option. 

• Factor Analysis. The pooling options, and matrix input/output, are available, as 
described above, for stepwise regression. 

Factor scores are calculated on option, and punched on option. 

Several options for the handling of communalities are available. 

Oblique and orthogonal rotations are allowed. 

• Analysis of Variance. A table generation feature allows output from the factorial 
design analysis in standard format. 

• Orthogonal Polynomials . These can be calculated for both equally spaced and 
unequally spaced intervals. 

Derivatives are calculated on option. 

Scaling of input is allowed on option. 
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CHAPTER 1: GENERAL OPERATING INSTRUCTIONS 

1. 1 SYSTEM GENERATION 

After preparing a disk with the monitor system (1130 Disk Monitor System, 1130-OS-OOl, 
described in manual C26-3750), the distributed source cards, preceded by a cold start 
card, can be loaded into the card reader hopper, and compiled and stored on the disk. 
It is not, however, necessary to store the total 1130 Statistical System on the disk 
before using any one of its four major programs. Within the discussion given for each 
specific program is information peirtaining to loading the particular set of routines 
necessary for that analysis type. 

The distributed decks consider that the operating system will use the 1132 Printer as 
output. If the console typewriter is to be used as the output device, monitor generation 
must consider this , and the IOCS card in each main program must be replaced by an 
IOCS card stating: 

*IOCS (CARD, TYPEWRITER, DISK) 

Identifying information for this exchange, which should take place before loading the 
statistical system , is listed below. 

Program Name IOCS Card Ihdentification (cc 73-80) 

COREL CORL 10 

POLY POLY 20 

POL2 POL2 20 

REGR REGR 20 

REGR2 RGR2 10 

ANOVA NOVA 20 

ANOV2 NOV2 20 

FCTR FCTR 10 

FCTRl FCTl 20 

FCTR2 FCT2 20 

FCTR3 FCT3 20 

In the routine PRNTB 

a. Card PRNB 150 should be changed to read LIBF TYPEZ. 

b. Cards PRNB 70 - PRNB 130 should be omitted. 

In the decks distributed with this system, identifying labels are given in cc 73-76. These 
four characters do not allow labels to agree perfectly with names of programs. When 
referencing programs, keep this distinction in mind. 

1. 2 CONTROL CARDS 

Each of the four programs included in the 1130 Statistical System requires monitor and 
program control cards. These cards are described in the job execution section of the 
specific program being considered. However, certain program control cards are 
standard for all programs. Their descriptions follow. 



For any control card, numbers specified as integers (I) (this includes all numbers used 
for program control) should be specified as follows: 

1. All numbers should be shifted to the right of their fields (right- justified) unless 
left justification is specifically called for. 

2. Blanks and zeros are synonymous. 

STANDARD PRQGEAM CONTROL CARDS 

Input/Output Units Card 

The function of the input/output units card (Figure 1) is to assign logical imit numbers 
to each of the I/O devices used throughout the program . Each subroutine that requires 
the use of an I/O device has been programmed with symbolic unit designations. This 
card fixes a number to a specific I/O device. 



Column 



1-2 



Meaning 

The unit for input of all control cards and source data. 
Normally, it is set equal to the logical number of the 
1442 card reader, which is 02. 



3-4 



The unit used for card output of computed matrices. Normally, 
it is set equal to the logical niunber of the 1442 card punch, 
which is 02. 



5-6 



Output switch 

- 1132 Printer output 

1 - Typewriter output 



CC: 1 2 3 4 5 6 



02 02 00 



Figure 1. I/O units card (printer) 



Job-Title Card 



The job-title card (Figure 2) allows the user to assign a job number and title information 
for the job to be processed. This information is used only for labeling and is not used 
for processing in any program. The job nimaber and title contained on the card are 
printed as the heading line on each page of output produced. The job number appears 
in the first four columns of any punched card output produced. 



CCi 1 4 9 

21 Multiple regression for class 3 data \0/7/6A 

Figure 2. Typical job-title oard 



Coliimn Meaning 

1-4 Job number 

5-8 This field is not used. 

9-80 Title information. These colimins may contain any legitimate 

key-punchable characters that serve to identify the job. 

Variable Format Card 



Each program was designed to allow some flexibility in the input of data. Although 
1130 FORTRAN does not allow the use of an object time format definition, a specially 
written format processing program is employed to enable the user to specify the format 
of his data by means of a FORTRAN-like statement. The format statement may contain 
almost all the specifications included in a normal FORTRAN format statement (as 
described in 1130 FORTRAN Language (C28-5933), pp. 11-15), with the following 
exceptions: 

1. Only I, E, F, or X data specifications are allowed. 

2. Continuation cards are not allowed. 

3. The use of a slash (/) is not permitted. 

4. Internal parentheses in the format specification are allowed. 

The format card Is punched with parentheses surrounding the specifications in columns 
1-80, as shown in Figure 3. 



CC: 1 



{(n, II, Fl.O, F5.2, F7.5 



.5, 3F2.1) 
Figure 3. Format card example 



Note: For each data card within an observation set (in case more than one 
card is required per observation), there must be a variable format 
card preceding the data deck. These format cards must be in the 
same order as are the cards in the observation sets. At most, the 
user will supply three format cards. 

1. 3 PROGRAM PAUSES AND MESSAGES 

1. Pause 10. An illegal character in a numeric field has been encountered in reading 
data. The program will print the card and the approximate column where the error 
was detected. Pressing START on the card reader and console will cause the 
remaining data cards to be read and Ignored. The next monitor control card, 
possibly signaling a new analysis, will be operated on. If this is not desired, the 
following should be done: 

It is possible that the format specification card is Incorrect. If this is so, the entire 
deck to be analyzed must be rerun. However, if a specific data card is in error, the 
reader hopper and the stacker should be emptied. Pressing the nonprocess rxmout 
button win clear the card read-punch, and the second card in the stacker will be the 
card containing the error. After correcting this card, the user should place it and 
the third stacker card at the front of the deck that was withdrawn from the hopper, 
place this entire deck in the reader hopper, and press START on the card reader and 
console to continue processing. 

2. Other error conditions are signaled by a printed message, and/or the program exits 
to the monitor. The monitor will read cards until a monitor control card is met 
(that is, the next job to be done), or will stop when the reader hopper is empty. For 
a list of the error messages, see chapter 5. 

3. When an analysis is terminated successfully, an end-of-job message is printed, and 
control is relinquished to the monitor. 

4. When the user calls for output on cards, a message is written reminding the operator 
to enter blank cards, if console entry switch 15 is not on. The computer then pauses 
to allow input of blank cards. If console entry switch 15 is on, no reminder is given. 
It is possible, in this case, to destroy the next analysis deck. See sections 1.4 and 
1.5. 

1.4 STACKING: SEQUENTIAL PROGRAM OPERATION 

Stacking of jobs is permitted. Each job must be a complete deck, as defined in the job 
execution section of each program. However, when a program option card calls for 
output on the IBM 1442 Card Punch, the negative identification card following the input 
data must be succeeded by blank cards. For each matrix requested in factor analysis or 
regression analysis, it is wise to place at least [n^/5 + 2n + 2] blank cards behind the 
data deck, where n is the nimaber of variables processed. For orthogonal polynomials, 
n + 1 blank cards should be included, where n is the order of the polynomial requested. 
When factor scores are to be punched, 2n blank cards should be included, where n is 
the number of observations processed. 



It is advisable to place extra blank cards in the hopper, because an insufficient nimiber 
could result in the destruction of a part of the next analysis deck. After an analysis is 
completed, cards are read until the next monitor control card is met, 

1. 5 TYPEWRITER AND PUNCHED CARD OUTPUT 

For t3T)ewrlter output, the 1130 Statistical System uses the same format statements as 
are used for the printer. A user electing to use this device heavily may desire to 
modify output using Assembler Language routines, calling on the typewriter tabulation 
feature. 

All system programs, excepting analysis of variance, allow user selection of punched 
card output. This is discussed briefly in sections 1. 3 (4) and 1.4. In the following, 
a detailed explanation of the mechanics of this operation is given. 

Consider first that stacking is not being done; only one job is being run. If the user 
places one blank card behind his input deck, it is unnecessary to press the card reader 
and console start buttons to complete the reading of the input data. If the user has asked 
for punched output in his analysis definition (option card), an adequate number of blank 
cards should be in the hopper following the data (section 1.4). If this is not the case, the 
computer halts, waiting for the entry of blank cards. After these are placed in the 
reader hopper, the start button should be pressed on the card reader and console to 
continue processing. 

If jobs have been stacked (section 1.4) and if, following the card with a negative 
identification field signifying end of data, there is another analysis deck (the next job), 
it is possible to destroy this next deck if punched output Is being requested in the 
current job. 

In this case, if console switch 15 is down (off), a message Is written reminding the 
user to place blank cards In the hopper; then the computer pauses. If this occurs, the 
card reader hopper (which contains the next job to be run) should be emptied, the non 
process runout button on the card reader should be pressed, and the last two cards in 
the stacker (//XEQ and a LOCAL card) should be placed at the front of the next job to 
be run. Blank cards should then be placed in the reader hopper, followed by the next 
job to be run, and START pressed on the card reader and console to continue processing. 

1.6 MACHINE AND SYSTEMS CONFIGURATION 

The 1130 Statistical System Is designed to operate on an 8K 1130 Computing System with 
disk storage (1131 Model II) and 1442 Card Read Punch; the 1132 Printer Is optional. 
It Is written to operate under the 1130 Disk Monitor System (1130-OS-OOl). 

1.7 PROGRAMMING LANGUAGE 

IBM 1130 FORTRAN and the IBM 1130 Assembler Language. 



1.8 REFERENCE MATERIAL 

IBM 1130 Disk Monitor System Reference Manual (C26-3750) 
IBM 1130 Assembler Language (C26-5927) 
IBM 1130 FORTRAN Language (C26-5933) 



CHAPTER 2: PROGRAMS 

2. 1 STEPWISE LINEAR REGRESSION 

From sets of observations numbering 499 or fewer, containing measures on a 
dependent variable y and n independent variables xi, x2, . . .x^, where the total number 
of variables is less than or equal to 30, the stepwise linear regression analysis will 
determine the coefficients of a linear equation of the form: 

y = b + b,x, + b-x„ + . . . b x 
•^ o 11 22 nn 

which best approximates the observations in the least-squares sense. 

The independent variables x^, X2, . . . , x^ are entered Into the equation on the basis 
of a variance criterion supplied by the user, which enables the program to determine 
which variable makes the greatest improvement in "goodness of fit". Similarly, 
variables are not entered, or removed, from the equation on the basis of a second 
variance criterion which indicates that the variable does not offer any significant 
improvement in the goodness of fit. 

The general method of solution to determine the coefficients h^, h^, . . .b^^ is to 
compute the matrix of correlation coefficients from the source data. This matrix will 
contain the correlations between all the independent variables and the dependent 
variable. By applying a Gaussian elimination inversion process, a stepwise inverse of 
the correlation matrix is computed. Multiplying this inverse by a vector containing 
the dependent variable correlated with each independent variable forms the normalized 
regression coefficients. The inversion process is carried out for one variable at a time. 
As each variable is processed, it is compared to the variance criterion to determine its 
significance. If the variable is to be entered, the coefficients for the equation containing 
a subset of the total number of variables in the analysis are computed and made 
available for printout and use in the next step of the analysis . Because of the nature of 
the computational process, the elements of several subsidiary statistics are also 
available. If the user elects to print each regression step as it is computed, these 
statistics will be printed with the regression coefficients. 

The followii^ book can be used as a reference: Ralston, A. and Wilf, H.S. 
Mathematical Methods for Digital Computers . New York: John Wiley and Sons, Inc., 
1960. 

2.1.1 Summary of Output Statistics 

1 . High and low value of each variable 

2. Means of each variable 

3. Standard deviation of each variable 

4. Sample variance for each variable 

5. Matrix of raw cross products 



6. Matrix of residual cross products 

7. Variance-covariance matrix 

8. Matrix of correlation coefficients 

9. Residual Standard Deviation 

10. Standard error of the mean of the predicted dependent variable 

11. Multiple correlation coefficient 

sum of squares due to regression 

12. Square of the multiple correlation coefficient = adjusted total sum of squares 

13. Degrees of freedom 

14. Regression coefficients - B 

15. Standard error of regression coefficients 



16. Partial correlation coefficients - r^ = a^ //a^ a^^ where n denotes the 
dependent variable and a is an element of the stepwise Inverse of the 
correlation matrix. 

17 . Normalized regression coefficients - B ; Bj = Bj Sj / Sy where Sj is the 
standard deviation of the i*^ independent variable 

18. Standard error of normalized regression coefficients 

19. For each data case, the predicted value and difference between the predicted 
value and the actual value 

20. Analysis of variance table 
2.1.2 Job Execution 

To perform a regression analysis, the user must supply three sets of cards to the 
program: 

1. Monitor control cards 

2. Program control cards 

3. Data cards 

Descriptions of the form and content of each card set follow. 

MONITOR CONTROL CARDS 

The monitor control cards are necessary to initiate program loading from the disk and 
to establish the necessary communication with the monitor. A general description of 
cards may be found in IBM 1130 Disk Monitor System Reference Manual (C26-3750). 



A regression analysis requires the following cards: 

CC: 14 8 16-17 

// XEQ REGR 03 

*LOCALREGR, FMTRD, PRNTB, DATRD, MXRAD, TRAN 
*LOCALCOREL, PRNT 
*LOCALREGR2, REGRE 

The monitor control cards do not change from job to job within one analysis type, but 
must be included with every job processed. The first program operated on by this 
system should be preceded by a cold start card. 

PROGRAM CONTROL CARDS 

The program control cards communicate the data-specific parameters and output 
options to the program. There are five possible card types necessary for execution: 

1. Input/output units card* 

2. Job-title card* 

3. Option card (described below) 

4. Variable name card (described below) 

5. Variable format card* 

Four of the control cards are required in every job. The variable format card, which 
specifies data forniat, is not necessary if matrix data is to be processed. 

OPTION CARD 

Number of Variables (cc 1-2) 

This field must be punched with a nonzero integer, n, which is less than or equal to 30. 
The value of integer n gives the total number of independent and dependent variables to 
be processed. 

Input Type and Source (cc 3-4) 

This field allows the user to specify the input device (1442 card reader or disk) and, 
indirectly, the type of input analysis to be undertaken in the input program. The three 
possible values that may be punched in this field are described below: 

Value Meanii^ 

1 Raw data will be read from the 1442 card reader and transferred 

to the disk, where it will be retained until destroyed by input from 



"See "General Operating Instructions", section 1. 2. 



Value Meaning 



1 one of the four programs in this system. Until destroyed, option 
(cont) 2 (below) can be used to read this data from the disk. 

2 Raw data will be read from the disk. Raw sums and raw sums of 
cross products will be accumulated. Data will be read until a 
negative number in the identification field is encountered 
(section 2.1.3). 

3 A previously computed matrix, or matrices, will be read from 
the 1442 card reader. Matrix cards will be read until a negative 
job number field is encountered (see "Pooling", section 2. 1.4). 

Sequence Checking Within Observations (cc 5-6) 

This field is used to indicate that raw data input from the card reader (cc 3-4 contains 
a 1) is to be sequence-checked. A value of zero or a blank field implies that no 
sequence check will be made. A value of one (1) implies that the cards will be 
sequence-checked. The sequence-checking process consists of an equal comparison 
check of the case identification field, for all cards in a case, and an ascending 
sequence check of the card number field. If an error in either of these conditions is 
encountered, the program prints a message, and the job is terminated. 

Number of Variables on Card 1 (cc 7-8) 

When a data vector contains more variables than will fit on one card, the user must 
indicate to the program the number of variables punched on each card. This field must 
be punched with the number of variables on the first card. If there is only one card 
per case, this field must be blank or zero. 

Number of Variables on Card 2 (cc 9-10) 

Same as cc 7-8, except that this field indicates the number of variables on the second 
card of the data. 

Nu mber of Variables on Card 3 (cc 11-12) 

Same as cc 7-8, except that this field indicates the number of variables on the third 
card of the data. 

Transformation Switch (cc 13-14) 

If the value in this field is nonzero, a user-written transformation subroutine is 
called after each data record is read and before any computation takes place. 

If the value in this field is zero or blank, the transformation subroutine is not called. 

The use of transformations is discussed in section 2. 5. 1. 
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Output Raw Sums of Cross Products (cc 15-16) 

This field is used to indicate whether the raw sums and sums of raw cross products 
matrix are to be printed, punched, printed and punched, or not presented. 

The four (4) possible values of this field are described below. The computation to 
generate the matrix is performed even if the "no output" option is chosen. 

Value Meaning 

or blank No output. 

1 Matrix will be printed. 

2 Matrix will be printed and punched. 

3 Matrix will be punched. 

Punched output of the raw sums of cross products matrix includes the number of 
observations and the vector of raw sums and sums of squares. This entire output 
must be entered on the pooling option (section 2. 1. 3). 

Output Residual Cross Products (cc 17-18) 

This field is used to indicate whether the residual cross products matrix — defined as: 

s.s. 
u.. = c..--i-i l,i = l,2,..n 

where c. are the elements of sums of raw cross products matrix, s^, s. are the raw 

simis of the i"~ and j~ variables, respectively, and n Is the number of cases — is to be 
printed, punched, printed and punched, or not presented. 

The four (4) possible values are described above under "Output Raw Sums of Cross 
Products ' ' . 

The matrix is computed even if the "no output" option is chosen. 

Output Variance-Covariance Matrix (cc 19-20) 

This field is used to indicate whether the variance-covariance matrix — defined as: 

u. . 
c =-^ l,j = l,2...n 

^ n-1 

where u^^ Is an element of the residual cross products matrix, and n is the number of 
cases (or sum of weights) — is to be printed, printed and punched, punched, or not 
presented. The four (4) possible values that may occur in this field are as given 
for the above matrices. 
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There are no additional vectors or matrices punched with the punched output. The 
matrix is computed even If the "no output" option is chosen. 

Output Correlation Matrix (cc 21-22) 

This field is used to indicate whether the correlation matrix — defined by: 

c. 

r.. = -^ i.j = 1,2. ..n 

ij s.s. •■ 

where c. is an element of the varlance-covariance matrix, and s., s. are the standard 

1] th th ^ •' 

deviations of the 1 — and j — variables, respectively — is to be printed, punched, printed 

and punched, or not presented. The four (4) possible values contained in this field 

are given above under "Output Raw Sums of Cross Products". 

The punched output of the correlation matrix includes the number of cases and cards 
containing the vectors of means and standard deviations. 

The matrix is generated even if the "no output" option is chosen. 

Compute and Print Predicted Values (and Residuals) (cc 23-24) 

This field is used to indicate the regression step to begin computing and printing the 
predicted values, defined as: 

Y. = b + b X., + b X + . . . b, x., 
1 1 il 2 i2 k ik 

where b , b , . . . b, are the coefficients of the regression equation for the k~ step, 

U JL K 

and x.. are the source data elements. 
I] 

If this field is blank or zero, the predicted values are not computed. If the field is 
negative, predicted values are printed only on the final step. 

If it contains a nonzero value, k, the predicted values are computed for each regression 
step equation containing k or more variables. For example, when k = 1, the predicted 
values for all step equations are printed. When k = 3, the predicted values for the 
equation containing three independent variables are printed. The printout also contains 
the actual value of y and the difference between the predicted and the actual values. 

If predicted values are requested when equations with fewer than p variables are not 
desired, no predicted values are printed. That is, if column 23-24 contains a positive 
integer less than the integer in column 25-26, no predicted values are printed. 
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Print Steps of Regression (cc 25-26) 

If this field contains a value of k, all step equations containing k or more Independent 
variables are printed. For example, if all steps are desired, a value of one (1) forces 
the printout of the equations containing 1, 2, ... m independent variables. 

If this field is zero or blank, no printout occurs. Only a correlation matrix is 
calculated. 

Poolii^ Option (cc 27-28) 

When using the matrix input option (cc 3-4 are 03) and when pooling sums of squares 
and cross products (section 2. 1. 3), if the user desires that matrices be subtracted 
rather than added (of aid in deletion of outlyers), this field should be nonzero. 

Number of the Dependent Variable (cc 29-30) 

The regression analysis program uses the value punched in this field to rearrange the 
correlation matrix, means, standard deviation, and variable names vectors, such that 
the dependent variable always follows the independent variables. The user must 
therefore indicate to the program the number of the dependent variable in this field. 
The value punched must be greater than zero and less than or equal to 30. A value of 
zero implies a regression analysis is not desired, and the program will exit after the 
correlation analysis is complete. 

Variance Criterion to Remove Variables (cc 31-34) 

This field is used to determine whether an independent variable, when removed from 
the equation, significantly increases the sample residual variance. The significance 
of the increase is determined by comparing it to the variance criterion as punched in 
this field. If the computed variance measure is greater than the criterion, the variable 
is removed from the equation. 

The form of the number to be punched is xxxx. A decimal point may replace any x. 
If there is no decimal point, the number is taken to be .xxxx. The size of this 
number depends on the information available to the particular analysis . If the 
user has no idea about the size to be used, a number between .005 and .05 may 
be acceptable. 

It is possible for the user to set criterion levels for entry and removal of variables 
that cause cycling of variables into and out of the model. The program does not check 
this cycling possibility. 

Variance Criterion to Enter Variables (cc 35-38) 

This field has a similar function to the previous field, except that the value punched is 
to determine whether a variable is to enter the equation. A variable is entered into 
the equation if it significantly reduces the sample residual variance. The computed 
variance is compared to this criterion value to determine whether it does decrease 
this variance. The typical values and the form of the punched data are exactly as 
described above for the remove-variable criterion. 
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A number twice the size of the removal factor can be tried if the user is not sure of the 
correct number to be used in this field. 

Tolerance For 111 Condition (cc 39-44) 

A poorly conditioned matrix occurs when an independent variable is approximately a 
linear combination of other independent variables. This number is associated, in the 
program, with the size of the pivot element. If the pivot element is less than the 
tolerance level, the associated variable is not entered into the model on the iteration 
in which the condition occurs. A tolerance level of zero is not to be advised, unless 
the user is sure that his matrix is not ill-conditioned. 

Regression Analysis Option Card Summary 

Column Meaning 

1-2 Number of variables 

3-4 Input type and source 

1 - Raw data input from card reader 

2 - Raw data input from disk 

3 - Matrix input from card reader 

5-6 *Check sequence of raw data input 

- No 

1 - Yes 



7-8 *Number of variables on card 1 

9-10 *Number of variables on card 2 

11-12 *Number of variables on card 3 

13-14 *Trans formation switch 

- No transformation 

1 - Transformation 

15-16 **Output raw cross products matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 

17-18 **Output adjusted cross products matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 

19-20 **Output variance-covariance matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 



(must be blank if there is only 
one card per observation) 



* Not pertinent when matrix input is used. 
** When correlation matrix input is used, matrices are not available for output. 
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Column Meaning 

21-22 """Output correlation matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 

23-24 *Output predicted values 

1 - Print predicted values for last step only. 
- Do not print predicted values . 
k - Print predicted values for models containing k 
or more independent variables 

25-26 Output steps of regression 

- Print no regression steps. Exit after correlation analysis. 

k - Print all steps for models containing k or more independent variables. 

27-28 Pooling option (see sections 2. 5. 3 and 2. 1. 4) 

Zero - Add matrices with ID = 1 

Nonzero - Subtract matrices with ID = 1 
29-30 Number of dependent variable 

31-34 Variance criterion to remove variables 

35-38 Variance criterion to enter variables 

39-44 Tolerance for colinearlty 

VARIABLE NAME CARD (Figure 4) 

In the multiple regression program there are a number of matrix printouts that the 
user may request. The variables in the matrix may be assigned a four-character name 
to aid in the identification of the output. The card is punched in four-column fields, and 
each field corresponds to the variable to be Identified (for example, field 3 (columns 
9-12) will be the name of row and column 3 on all matrix output). At most, 20 names 
can appear on one card. If there are more than 20 variables in the analysis, a second 
card having the same format as the first must be Included In the control card deck. 

Column Meaning 

1-4 Name of variable 1. 

5-8 Name of variable 2. 



(4N-3) - (4N) Name of variable N. 



* Not pertinent vvhen matrix input is used. 
** When correlation matrix ii^ut is used, matrices are not available for output. 
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CC: 1 



4 5 



8 9 



12 13 \6 



GRP 1 



ANL 



XX 



Figure 4. Variable name card example 



2.1.3 Data Input 

Raw data input to the regression program consists of a set of observations made on 
several different variables. The variables for each observation are punched on one, 
two, or three cards, according to the following general form: 

Field Type Meaning 

1 Integer (I) Identification field. Any numeric Information that serves 

to identify the particular observation is punched in this 
field. It must be greater than zero, and should be 
different for each observation, 

2 Integer (I) Card number within observation. If it is not possible 

for one card to contain all the variables, they may be 
continued on a second and a third card, as necessary. 
The user has the option of sequence checking the cards 
to ensure that all cards within a case are together, and 
that the order of cards is consistent. If the option is 
chosen (cc 5-6 on option card), this field must be punched 
with an Integer that is in ascending sequence for all cards 
In the case. If sequence checking is not desired, the 
field may be blank and may consist of one blank column. 

3, 4, . . . , n Floating Observation on variable xj^' ^^V number may be 

etc. point (F) punched in this field. Decimal points are not required. 

The remaining fields on the card are reserved for variable 
observations. If there are more variables than can fit on the 
first card, a second and a third card may be used. 

The particular card columns for each field are arbitrary. 
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Following the data deck, the user must Include a card containing a negative integer in the 
identification field. This card signals the end of data. 

2.1.4 Matrix Input/Output 

It is possible to obtain punched card output of a number of matrices (see section 2.5.3) 
and vectors with the regression program. This program is designed to also input some 
of these matrices, at a later time, for further analysis or processing. In addition, 
matrices from another program or source, if punched in the proper format, may 
also be used as input. 

This section is devoted to a description of various possible forms of analysis with the 
output options available in each program. 

Format Description 

Matrices are punched rowwise, five elements to a card, in the FORTRAN E or floating- 
point format. Each card is identified as to its job number, matrix number, row 
number, and column number of the first element on the card. The specific card 
columns occupied by the identification fields, and matrix elements, are shown below: 

Column Meaning 

1-4 Job number 

5-6 Matrix identification 

number (section 2.5.3) 

7-8 Column number of first 

element on card 

9-10 Row number 

11-24 Matrix element 

(±0. XXXXXXXEiNN) 

25-38 Matrix element 

39-52 Matrix element 

53-66 Matrix element 

67-80 Matrix element 

Note that all matrices are punched and read under a fixed format. Hence, a variable 
form.at card is not allowed when using punched card matrices as input. 

Most matrices have a unique identification number. However, there are a few cases 
where two or three vectors have the same identification and are always punched 
together. For these cases, see section 2. 5. 3. 
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Regression with Correlation Matrix Input 

The punched output option of the correlation matrix includes the punchout of the number 
of cases (matrix 21), and means and standard deviation vectors (matrix 23). This 
complete output can be used as input to initiate another analysis without the necessity 
of reprocessing the raw data used to generate the matrices. 

To use the correlation matrix set as input, the user places the punched output behind 
the variable names card, followed by a card that contains a negative number in the job 
number field. The program reads the number of cases, means, standard deviations, 
and correlation matrix, storing each in its appropriate location, and then initiates the 
analysis as specified on the option card. No matrix output is possible in this case. 
Also, observations are not read; hence, predicted values and certain summary statistics 
are not available. 

Pooling Sums of Squares and Cross Products (cc 27-28) 

In the regression and factor analysis programs, a considerable amount of processing 
time is devoted to accumulating raw sums and raw cross products as each data vector 
is read. If there is a large amount of source data, or if there is some logical 
division in the data set, it is frequently desirable to obtain partial punched output of the 
raw sums of squares and cross products. These partial outputs can then be added 
together to complete the total analysis in another job. 

Both programs allow this type of analysis. By choosii^ the punchout option for this 
matrix, the program includes in the punchout the number of cases, and raw sums 
and sums of squares vectors, in addition to the raw cross products matrix. Any 
number of these matrices may be punched and used later to complete the analysis. The 
user simply stacks each output set, one after the other, following the variable names 
card. The program reads the matrices, examining the matrix identification and row 
and column numbers to determine the location or group of locations to which the matrix 
is to be added. The read- add operation is terminated when a card with a blank or 
negative job number field is encountered, unless the pooling option (cc 27-28 of the 
option card) is nonzero. In this case, the read-add operation terminates at the first 
detection of a blank or negative job number field, and the second (succeeding) matrix 
is subtracted from the previous matrix. This operation is terminated when the second 
blank or negative job number is encountered. 

If the subtraction option is used, the second set of matrices must also include its 
associated raw sums and sums of squares vectors for proper analysis completion. 

Predicted values are not available with this option. Also, high and low values are not 
calculated for the observations on variables. 

If outlyers are detected, the user has two options available if he wishes to reanalyze 
ignoring these outlyers: 

1. He can eliminate the data cards containing the outlyers, and rerun the entire 
analysis. 
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2. He can prepare cards according to the format given above under "Format 

Description", either by hand or by using the program. To use the program, he must 
run the analysis usir^ only data cards associated jyith outlyers. The option card must 
request raw cross products matrix output, and may note that the dependent variable is 
zero, so that the analysis will terminate after the correlation matrix is calculated. 
If the user allows an entire regression analysis to be computed using only the outlyer 
cards, a termination with some error condition may result — for example, mean 
square nonpositive. In any case, matrices 1, 21, and 22 will be punched (see 
section 2. 5. 3). These matrices should be used as the second set of matrices for 
input using the subtraction option. 

2.1.5 Operating Instructions 

A. Using the regression analysis program when the total 1130 Statistical System has 
not been stored on the disk 

If the user wishes to load only the set of programs that allow regression analyses, the 
following programs must be compiled or assembled and stored on the disk. Each deck 
begins with a card punched as 

//FOR 
and ends with an 

♦STORE 

card. 

The user should use a disk containing the 1130 Disk Monitor System, as described in 
section 1. 1. The followii^ decks should be preceded by a cold start card, placed in 
the card reader hopper, and the buttons IMMEDIATE STOP (console), RESET (console), 
START (card reader), and PROGRAM LOAD (console) should be pressed. A blank card 
should be placed after the last deck in the card reader hopper. 

DECKS-LABELS : REGR-REGR; **COREL-CORL; **PRNT-PRNT; 
*FMTRD-FMRD; *DATRD-DTRD; *PRNTB-PRNB; *GMPYX-GMPY; 
*GDIVX-GDIV; **MXRAD-MXRD; REGR2-RGR2; REGRE-RGRE; 
*FMAT-FMAT; TRAN-TRAN. 

In addition, regression and factor analysis programs must reside on the disk together; 
section 2.2.7 names additional routines to be placed on the disk. 

B. Execution from disk 

Once the component subroutines and main calling programs are on the disk, the execution 
of a job requires the monitor control cards, program control cards, and data cards to be 



*Used in all four analysis t3T)es 
**Used in factor analysis 
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placed in the card reader. The deck should be preceded by a cold start card. To 
initiate processing, the buttons IMMEDIATE STOP and RESET (console), START (card 
reader and printer), and PROGRAM LOAD (console) should be pressed. The order in 
which the cards are placed in the card reader for either matrix or raw data input is 
shown in Figures 5, 6, and 7. 






megat 



_^.ionQl Blank 
Output 



ive Ident 



fl 



[Data Deck 



orlable Format 



f Variable Names 



fo^v 



ion Card 



fjob-TiH 



e Card 



/Input/Output 

J_,.f.. 



U nit? 



Monitor 
Control Cards 



Figure 5. Regression card order — card reader Input 



A 



Optional 
Blank Output 



Variable 
Names 



f^Option 



Job-Title 



("^Input/Output 
I Units 



Monitor 
Control 



/ 



Figure 6. Regression card order — disk input 
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Optional Blanl< 
Output 



Negative 
Identification 



^Matrix 



''Matrix 1 



/Opti( 



Variable 
Names 



/Job-Title 
/I/O Units 



Monitor 
Control 



Kto be addpd to matrix 1 ) 



Figure 7. Regression card order — matrix itq)ut 

2.1.6 Sample Problem 
INPUT 



// XEQ REGR 03 

♦LOCALREGR,FMTRO,PRNTB,DATROtMXRAD,TRAN 

*L0CALREGR2,REGRE 

*LOCALCOREL,PRNT 

020200 

2222 STEPWISE TEST ONE 

06010000 0001010102-1010006.500.300.00010 

PI P2 P3 P4 P5 P6 
1212. IX ,F5.2,F5.0,2F5.2,2F5.0) 
0101 002500002502500001500003400064 
0201 013000002102100000870003600065 
0301 003500002202200000430004100082 
0401 001750000900130001800001500023 
0501 003000002302300002000003300064 
0601 002000001000060003300001300015 
0701 005500000700140003400001600012 
0801 006000000600080005000001100027 
0901 001300000800270001 500001900048 
1001 005000001800360001800002700050 
1101 005000000300100001400001400012 
1201 003000000800270001000002500013 
1301 002000000600300001500002100020 
1401 002000000800100002500001800023 
1501 001000002202200001100004600118 
1601 004000001301300002 800001700050 
1701 000500002600120000 730004800063 
1,801 000250002302300000100003600150 
1901 014000000300100003500000500072 
2001 0025000015002 500002 80003300054 
2101 003500002801400000010004600109 
2201 003500000600060005 000001000010 
2301 00250000350350000570000380012 5 
2401 000500001100200003400001600044 
2501 002 000001101100000500002000048 
2601 0070000032032 00006600003800105 
2701 004000000800100004500001200009 
2801 015000002302300000150004900130 
2901 001000003803800002200004300160 
3001 003500001500500001500003300048 
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3101 013000000600120003 700000900036 
3201 002000002502500001000003500150 
3301 012000000500170000300002100078 
3401 004000000900075001900001700023 
3501 003000000700350002600001200042 
3601 008000002002000002200003000072 
3 701 009000000600086002500001500020 
3 801 00600000120040000120000200 0036 
3901 008000002600160001100003 500056 
4001 001500001500300001600002900036 
4101 007000001000090010000001200026 
4201 008000002802800004200004000108 
4301 002000003403400000900004200106 
4401 006000000400080003600001100016 
4501 015000003203200001800004400104 
4601 017000001101100002300001400047 
4701 016000000200050001800001 100027 
4801 003000001800160001100003200012 
4901 006000000300040001300001500007 
5001 014000000800110002000001700018 
5101 00600000140009000070000290002 8 
5201 001800001200240001500002100025 
5301 015000000300150000800001300011 
5401 018000000600550005 700000900020 
5501 005000001200200004100001600014 
5601 030000001101100002 00000220003 8 
5 701 029000000800800001000002200103 
5 801 001800002402400001100003800105 
5901 013000002602600001700003800063 
6001 019000002902900048000002900208 
6101 01 100000 170 17'00001600002500032 
6201 010000001500500003 500001900028 
6301 006000001000500001000002600032 
6401 005000002202200001200003900100 
6501 001000001500500000800002900050 
6601 017000000900300013000001000080 
6701 005000003003 500000900005 800065 
6801 00130000100013000900000100002 5 
-1 

PUNCHED CORRELATION MATRIX OUTPUT 

2222 4 1 1 O.IOOOOOOE 01-C. 1 764550E 00 . 5134508E-02 C.2554817E 03-0 . 1956 896E 03 

2222 4 1 2-0.1764650E 00 O.IOOOOOOE 01 0.8679906E 00 C.1007193E CO 3.8791197E OD 

2222 4 1 3 0.5134508E-02 0.8679906E 00 O.IOOOCOOE 01 0.1258658E 00 0.7519358E G3 

2222 4 14 0.2554817E 00 0.1007193E 00 0.1258658E 00 O.IOOOOOOE 01-0. 14043T7E 03 

2222 4 1 5-0.1956896E 00 0.8791ig7E 00 0.7519358E 00-0 . 1404377E 00 O.nOOCOOF 01 

2222 4 1 6 0.820551ZE-01 0.7496L67E 00 0.7860574E 00 0,3425673E 00 0.6451673E CC 

2222 4 6 

2222 4 6 

2222 4 6 

2222 4 6 

2222 4 6 

2222 4 6 

222223 1 

222223 1 2 0.1525000E 02 0.9357534E 01 

222223 1 3 0.1042514E 02 0.1162702E 02 

222223 1 4 0.3099554E 01 0.5997127E 01 

222223 1 5 0.2539706E 02 0.1247940E 02 

222223 1 6 0.5679412E 02 0.4355013E 02 

222221 1 1 0.6800001E 02 

OUTPUT 



1 


O.IOOOOOOE 


01- 


-c. 


, 1764550E 


00 


2- 


-0.1764650E 


00 


0. 


.lOOOOOOE 


01 


3 


0.5134508E- 


-02 


0. 


, 8679906E 


00 


4 


0.2554817E 


00 


0. 


. 1007193E 


00 


5- 


-0. 1956896E 


00 


0. 


,8791ig7E 


00 


6 


0.820551ZE- 


-01 


0, 


, 7496L67E 


00 


1 

2 


0.8205512E- 
0.7496167E 


-01 
00 








3 
4 


0.7860574E 
0.3425673E 


00 

00 








5 


0.6451673E 


00 








6 


O.IOOOOOOE 


01 








1 


0.6995588E 


01 


0, 


,6473750E 


01 
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// XEO RE6R 03 

«L0CALRE6R*FMTRD«PRNTBtDATRD»MXRA0tTRAN 

*L0CALREGR2*RE6RE 

•LOCALCOREL.PRNT 



(2I2>1X 



STEPWISE TEST ONE 

NUMBER OF VARIABLES 6 

INPUT TYPE 1 

SEQUENCE CHECK 

VARIABLES ON CARD 1 

VARIABLES ON CARD 2 

VARIABLES ON CARD 3 

TRANSFORMATION SWITCH 

OUTPUT RAW CROSS PRODUCTS 1 

OUTPUT RESIDUAL CROSS PRODUCTS 1 

PRINT PREDICTED VALUES -1 

PRINT STEPS 1 

POOLING OPTION 

DEPENDENT VARIABLE 6 
F-LEVEL TO REMOVE VARIABLES 0.500 
F-LEVEL TO ENTER VARIABLES 0.300 
TOLERANCE VALUE 0.00010 

OUTPUT VARIANCE - COVARIANCE 1 

OUTPUT CORRELATION 2 
.FS.2.FS.0.2FS.2.2F5.0) 



JOB 2222 



PAGE 



STEPWISE TEST ONE 



JOB 2222 



PAOE 



MATRIX OF RAW CROSS-PRODUCTS 



VARIABLE 


PI 




P2 




P3 




P4 




P5 




P6 




PI 


0.613S7E 


04 


0.653B1E 


04 


0.49851E 


04 


0.21390E 


04 


0.11022E 


05 


0.2eS66E 


OS 


P2 


0.6;381E 


0« 


0.21681E 


05 


0.17138E 


05 


0.35929E 


04 


0.33215E 


05 


0.79363E 


05 


P3 


O.tfSSlE 


0* 


0.17138E 


05 


0.1644eE 


05 


0.2TB53E 


04 


0.25314E 


05 


0.66929E 


05 


P« 


0.21390E 


04 


0.35929E 


04 


0.27853E 


04 


0.30629E 


04 


0.46487E 


04 


0.17964E 


05 


P5 


0.11022E 


O-! 


0.3321iE 


05 


0.25314E 


05 


0.46487E 


04 


0.54296E 


05 


0.12197E 


06 


P6 


0.28S66E 


05 


0.79S63E 


05 


0.66929E 


05 


0.I7964E 


05 


0,12157E 


06 


0.34641E 


06 



STEPWISE TEST ONE 



MATRIX OF RESIDUAL CROSS-PRODUCTS 



VARIABLE 


PI 




P2 




P3 




P4 




P5 




P6 




PI 


0.28079E 


04 


-O.T1622E 


03 


0.29893E 


02 


0.66455E 


03 


-O.10592E 


04 


0.15499E 


04 


P2 


-0.71622E 


03 


0.58667E 


04 


0.63273E 


04 


0,37869E 


03 


0.68782F. 


04 


0i20467E 


05 


P3 


0.29e93E 


02 


0.63273E 


04 


0.90575E 


04 


0.58e02f 


03 


0.73100f 


04 


0.26667E 


05 


P4 


0.66455E 


03 


0.37869E 


03 


0.58e02E 


03 


0.24096E 


04 


-0.70419E 


03 


0.59945E 


04 


P5 


-0.10592E 


04 


0.6e7e2E 


04 


0.73100E 


04 


-0.70419E 


03 


0.10434E 


05 


0.23492E 


05 


P6 


0.15499E 


04 


0.20467E 


05 


0.26667E 


05 


0.59945E 


04 


0.23492E 


05 


0.12707E 


06 
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STEPWISE TEST ONE 



JOB 2222 



PAGE 



VARIANCE - COVARIANCE MATRIX 



VARIABLE 


PI 




P2 




P3 




PI 


0.41909E 


02 


-0.10689E 


02 


0.38647E 


00 


P2 


-0.106fl9E 


02 


0.87563E 


02 


0i94437E 


02 


PS 


0.38647E 


00 


0.94437E 


02 


0.135ieF 


03 


P« 


0.99187E 


01 


a.S6921E 


01 


0.B7764E 


01 


PS 


-0<1«809E 


02 


0.10266E 


03 


a>10910E 


03 


P6 


0.23134E 


02 


0«30S48E 


03 


0.39eo2E 


03 



P4 P5 96 

0t99187E 01 -0.1'iB09E 02 0.23134E 02 

0>96S21E 01 0«10266E 03 0a3054SE 03 

0<87T64E 01 0>10910F 03 0>39802E 03 

0.35965E 02 -OtlOSlOF 02 0«8947CE 02 

-0.10510E 02 0.1S573E 03 0.35063E 03 

0>S9470E 02 0<39063E 03 0«l8966E 04 



STEPWISE TEST ONE 



JOB 2222 



SUMMARY STATISTICS 



'AP 


IIABLE 


LOW 


HIGH 




AVERAGE 


STD. DEV. 


VARIANCE 




PI 


0i29000E 00 


0.30000E 


02 


0ift99SSE 01 


0.64737E 01 


0.41909E 02 




P2 


Oi20000E 01 


0.38000E 


02 


0.192S0E 02 


0.93575E 01 


0.87563E 02 




P3 


0.40000E 00 


O.jgOOOE 


02 


0.10429E 02 


0.11627E 02 


0.13518E 03 




P» 


O.lOOOOE-01 


0.48000E 


02 


0t30995E 01 


0«59971E 01 


0<39969E 02 




P5 


OiSOOOOE 01 


o.seoooE 


02 


0.253976 02 


0.12479E 02 


0.15973E 03 




P6 


0.70000E 01 


Oi2oeooE 


03 


0.56794E 92 


0>439$0E 02 


0.18966E 04 



READY THE PUNCH WITH BLANK CARDS AND PRESS START ON THE PUNCH AND CONSOLE. TURN CONSOLE SWITCH 19 ON. 



STEPWISE TEST ONE 



PACE 



MATRIX OF CORRELATION COEFFICIENTS 



VARIABLE 


PI 


P2 




P3 




P4 




P9 




P6 


PI 


O.IOOOOE 01 


-0.17646E 


00 


0.91349E- 


•02 


0.29948E 


00 


-0.19968E 


00 


0.82095E-01 


P2 


-0.17646E 00 


O.IOOOOE 


01 


0.86799E 


00 


0.10071E 


00 


0.e7911E 


00 


0.74961E 00 


PS 


0.9134SE-02 


0.S6799E 


00 


O.IOOOOE 


01 


0.12966E 


00 


0.79193E 


00 


0.78«09E 00 


P4 


0.29948E 00 


0.10071E 


00 


0.12986E 


00 


O.IOOOOE 


01 


-0,140436 


00 


0.34296E 00 


P9 


-0.1996aE 00 


0.87911E 


00 


0.7S193E 


00 


-0.14043E 


00 


O.IOOOOE 


01 


0.64916E 00 


P6 


0.B2055E-O1 


0.74961E 


00 


0.78605E 


00 


0,34296E 


00 


0.64916E 


00 


O.IOOOOE 01 
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STFPWISE TEST ONc 



JOB 2222 



REGRESSION ANALYSIS 

DEPENDENT VARIABLE P6 

RESIDUAL STANDARD DEVIATION 27.1238 

STANDARD ERROR OF THE MEAN 3.2892 

MULTIPLE R 0.7860 

MULTIPLE RSOR 0.6178 



VARIABLE ENTERED 



VARIABLE 


B - ^OEF 


STD ERROR OF B 


PARTIAL-R 


BETA-COEF 


STD ERROR OF BETA 


P3 


2.9*42 


0.2860 


0.7860 


0.7860 


0.0760 


ONSTANT 


26.0998 











SOURCE 



ANALYSIS OF VARIANCE TABLE 

D.F. SUM OF SQUARES MEAN SQUARE 



MEAN 


1 


0.21933E 06 


0.2i933E 


06 




REGRESSION 


1 


0.78516E 05 


U.78516E 


05 


0.10672E 03 


ERROR 


66 


0.*85b6E Ob 


0.73570E 


03 





STEPWISE TEST ONE 



REGRESSION ANALYSIS 

DEPENDENT VARIABLE P6 

RESIDUAL STANDARD DEVIATION 25.0821 

STANDARD ERROR OF THE MEAN 3«0416 

MULTIPLE R 0.8235 

MULTIPLE RSOR 0.6781 



VARIABLE ENTERED 



VARIABLE 



P3 
P4 



B - i-OEF 



2.827S 
1.7976 



STD ERROR OF B 

0.2656 
0.5150 



PARTIAL-R 



0.7971 
0.3972 



BETA-COEF 



0.7548 
0.2*75 



STO ERROR OF BETA 

0.U709 
0.0709 



CONSTANT 



21.7<><>5 



SOURCE 



ANALYSIS OF VARIANCE TABLE 

D.F. SUM OF SQUARES MEAN SQUARE 



MEAN 


1 


0.21933E 06 


0.21933E 06 




REGRESSION 


2 


0.861S0E 05 


0.43090E 05 


0.68493E 02 


ERROR 


65 


0.40892E 05 


0.62911E 03 
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STEPWISE TEST ONt 



JOB 2222 
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REGRESSION ANALYSIS 

DEPENDENT VARIABLE P6 

RESIDUAL STANDARD DEVIATION 23.9328 

STANDARD ERROR OF THE MEAN 2.9022 

MULTIPLE R 0.8435 

MULTIPLE RSOR 0.7115 



VARIABLE ENTERED 



P5 



VARIABLE 

P3 
P4 
P5 



- COEF 

1.9583 
2.3123 
1.0355 



STD ERROR OF B 

0.4079 
0.5266 
0.3808 



PARTIAL-R 

0.5145 
0.4811 
0.3217 



BETA-COEF 

0.5228 
0.3184 
0.2967 



STO ERROR OF BETA 

0.1089 
0.0725 
0.1091 



CONSTANT 



2.9105 



SOURCE 

MEAN 

REGRESSION 

ERROR 



ANALYSIS OF VARIANCE TABLE 

D.F. SUM OF SQUARES MEAN SQUARE 



1 

3 

64 



0.21933E 06 
0.90415E 05 
0.36658E 05 



0.21933E 06 
0.3O13eE 05 
0.57278E 03 



0.92617E 02 
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RE6RESSI01 ANALYSIS 

DEPENDENT VARIABLE P6 

RESIDUAL STANDARD DEVIATION 23.9726 

STANDARD ERROR OF THE MEAN 2.9071 

MULTIPLE R 0.8456 

'MULTIPLE RSOR 0.7150 



VARIABLE ENTERED 



PI 



VARIABLE 


B - COEF 


STO 


ERROR OF B 


PARTIAL-R 


BETA-COtF 


STD 


ERROR OF 


PI 
P3 

P4 
P5 


0.4272 
1.1967 
2.2333 
1.1167 




0.4813 
0.4145 
0.S349 
0.3923 


O.UU 
0.4994 
0.4654 
0.3375 


0.0635 
0.5063 
0.3075 
0.3200 




0.0715 
0.1106 
0.U736 
0.1124 


CONSTANT 


-1.2530 















SOURCE 



ANALYSIS OF VARIANCE TABLE 

O.F. SUM OF SQUARES MEAN SOUARE 



MEAN 


1 


0.21933E 06 


Ot21933E 06 




REGRESSION 


4 


0.90867E 05 


0.22716E 05 


0.3y529E 02 


ERROR 


63 


0.36205E 05 


0.57468E 03 
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PREDICTED VALUES 



^SE 


ACTUAL 


PREDICTED 


RESIDUAL 


1 


0.6400E 


02 


a<a899E 


02 


-0.24S9E 02 


2 


0>6900E 


02 


0.9627E 


02 


-0>212TE 02 


3 


0>»200E 


02 


0.e871E 


02 


-0.6717E 01 


4 


0.2300E 


02 


0.2273E 


02 


0.2«e2E 00 


9 


0<6400E 


02 


0>8497E 


02 


-0.2097E 02 


6 


0<1600E 


02 


0.2262E 


02 


-0.6627E 01 


7 


0*1200E 


02 


0.2921E 


Ol2 


-0.l721e 02 


8 


0.270OE 


02 


0«2627E 


02 


0>7213E 00 


9 


0>4«OOE 


02 


0.2e99E 


02 


0il900E 02 


10 


0.9000E 


02 


0i4188E 


02 


0<8116E 01 


11 


0.1200E 


02 


0a2194E 


02 


-Ot9S41E 01 


12 


0.1300E 


02 


0.S930E 


02 


-0.2230E 02 


13 


0.2000E 


02 


0.3209E 


02 


-0il209E 02 


U 


0<230aE 


02 


0.2718E 


02 


-0a4la»E 01 


19 


0.1180E 


03 


0.9473E 


02 


0a2326E 02 


16 


0.5000E 


02 


0.5039E 


02 


••0.3917E 00 


17 


0.6300E 


02 


0.9647E 


02 


0>6S28E 01 


19 


0«1»00E 


03 


0.8290E 


02 


0.6709E 02 


19 


0.7200E 


02 


0.2002E 


02 


0.9197E 02 


20 


0,9400E 


02 


0.4203E 


02 


0.1196E 02 


21 


0.1090E 


03 


0.7818E 


02 


0.3081E 02 


22 


O.IOOOE 


02 


0.2371E 


02 


-0.1371E 02 


23 


0.i290E 


03 


0.1213E 


03 


0.3631E 01 


24 


0.44aOE 


02 


0.2e2lE 


02 


0.1978E 02 


29 


0.4600E 


02 


a.439lE 


02 


0.4082E 01 


26 


0>1090E 


03 


0.1196E 


03 


-0.1461E 02 


27 


Ot9000E 


01 


0.2990E 


02 


-0.1680E 02 


29 


0.1300E 


03 


0.1038E 


03 


0.26t6E 02 


29 


0.l6aOE 


03 


0.1241E 


03 


0.3981E 02 


30 


0.4800E 


02 


0.4992E 


02 


-0<1928E 01 


31 


0«3600E 


02 


0.2489E 


02 


O.lllOE 02 


32 


0.1500E 


03 


0.8633E 


02 


O16I66E 02 


33 


0.7900E 


02 


0.3121E 


02 


0.4678E 02 


34 


0t2300E 


02 


0.2910E 


02 


-0>2106E 01 


3» 


0. 42006 


02 


0.2S87E 


02 


0.1612E 02 


36 


0.7200E 


02 


0.7891E 


02 


-0.6915E 01 


37 


0t2000E 


02 


0.2699E 


02 


-Oi6S97E 01 


39 


0«3600E 


02 


0.3391E 


02 


0«2087E 01 


39 


0.5600E 


02 


0<4674E 


02 


0.9297E 01 


40 


0a3600E 


02 


Ot4103E 


02 


-0.9037E 01 
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PREDICTED VALUES 



«SE 


ACTUAL 


PREDICTED 


RESIDUAL 




0.2600E 


02 


0.3917E 


02 


-0.1317E 


02 




0.1080E 


03 


0.1093E 


03 


-0al323E 


01 




0al060E 


03 


0.1130E 


03 


-0a7004E 


01 




0.1600E 


02 


0.2319E 


02 


-0.71»le 


01 




0.1040E 


03 


Oall90E 


03 


-OalSOOE 


02 




0.4700E 


02 


0.4T64E 


02 


-0a64S0E 


00 




0.2700E 


02 


0.2283E 


02 


0a4164C 


01 




0.1200E 


02 


0.412SE 


02 


-Oa2»29E 


02 




0.7000E 


01 


0.21 72E 


02 


-0.1472E 


02 




OtieoOE 


02 


0a3O26E 


02 


-0.1226E 


02 




0a280OE 


02 


aa3696E 


02 


-0a896«E 


01 




0.2900E 


02 


0.3O87E 


02 


-0.9869E 


01 




O.llOOE 


02 


0.2430E 


02 


-0.1S30E 


02 




0. 20006 


02 


0a3964E 


02 


-0.1964E 


02 




0«1400E 


02 


0.3170E 


02 


-0.1770E 


02 




0«3800E 


02 


0a6146E 


02 


-0.2346E 


02 




0«1030E 


03 


0.9311E 


02 


Oa49aeE 


02 




O1IO6OE 


03 


0.8993E 


02 


Oal606E 


02 




0>6300E 


02 


0.9984E 


02 


-0a3«84E 


02 




0.2080E 


03 


0.2014E 


03 


0.6943E 


01 




Ot3200E 


02 


0.671eE 


02 


-0a3918E 


02 




Oa2800E 


02 


0.4193E 


02 


-0al393E 


02 




0.3200E 


02 


0.4206E 


02 


-0.1006E 


02 




OalOOOE 


03 


0.8884E 


02 


O.lllSE 


02 




O.SOOOE 


02 


0a4283E 


02 


0.7169E 


01 




OtSOOOE 


02 


0.5190E 


02 


0a2809E 


02 




Oa6900E 


02 


0.1340E 


03 


-0a6»0SE 


02 




0>2900E 


02 


at3103E 


02 


-Oa803SE 


01 
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CORRELATION MATRIX INPUT 



// XEQ REGR 03 

•LOCALREGR.FMTRO,PRNTB,OATRO,HXRAD,TRAN 

•L0CALREGR2,REGRE 

•LOCALCOREL.PRNT 

020200 

2222 STEPWISE TEST ONE 



06030000 




000000000000010006.500.300, 


.00010 










PI 


P2 


P3 P4 P5 


P6 
















2222 


4 




1 


0. lOOOOOOE 


01- 


-0.1764650E 


00 


0.5134508E- 


-02 


0. 


,2554817E 


00- 


2222 


4 




2- 


-0.1764650E 


00 


0. lOOOOOOE 


01 


0.86 79906E 


00 


0. 


,1007193E 


00 


2222 


4 




3 


0.5134508E- 


-02 


0.8679906E 


00 


0. lOOOOOOE 


01 


0. 


,1258658E 


CD 


2222 


4 




4 


0. 255481 7E 


00 


0.1007193E 


00 


0.1258658E 


00 


0. 


,IDOOOOOE 


CI 


2222 


4 




5- 


-0.1956896E 


00 


0.8791197E 


•06 


0.7519358E 


00- 


-0. 


, 1404377E 


00 


2222 


4 




6 


0.8205512E- 


-01 


0.7496167E 


00 


0.7860574E 


00 


0. 


.3425673E 


0.0 


2222 


4 




1 


0.8205512E- 


-01 
















2222 


4 




2 


0.7496167E 


00 
















2222 


4 




3 


0.7860574E 


00 
















2222 


4 


6 


4 


0. 34256 73E 


00 
















2222 


4 


6 


5 


0.6451673E 


00 
















2222 


4 


6 


6 


0. lOOOOOOE 


01 
















222223 




1 


0.6995588E 


01 


0.6473750E 


01 












222223 




2 


0.1525000E 


02 


0.9357534E 


01 












222223 




3 


0.1042514E 


02 


0.1162702E 


02 












222223 




4 


0.3099554E 


01 


0.5997127E 


01 












222223 




5 


0. 2539706E 


02 


0.1247940E 


02 












222223 




6 


0.5679412E 


02 


0.4355013E 


02 












222221 
-1 




1 


0.6800001E 


02 
























OUTPUT 















■0.1956P96E 00 

0.8791197E CO 

0.7519358E 00 

■0.1404377F 00 

0. lOOOOOOE 01 

0-6451673E 00 



// XEO REGR 09 
•L0CALRE6R»FMTRD»PRNTB«DATRD»MXRAD»TRAN 

»L0CALREGR2fRE6RE 
•LOCALCORELtPRNT 



STEPWISE TEST ONE 

NUMBER OF VARIABLES 6 

INPUT TYPE 3 

SEQUENCE CHECK 

VARIABLES ON CARD 1 

VARIABLES ON CARD 2 

VARIABLES ON CARD 3 

TRANSFORMATION SWITCH 

OUTPUT RAW CROSS PRODUCTS 

OUTPUT RESIDUAL CROSS PRODUCTS 

PRINT PREDICTED VALUES 

PRINT STEPS 1 

POOLING OPTION 

DEPENDENT VARIABLE 6 

F"LEVEL TO REMOVE VARIABLES 0.500 

F-LEVEL TO ENTER VARIABLES 0.300 
TOLERANCE VALUE 0.00010 

OUTPUT VARIANCE - COVARlANCE 

OUTPUT CORRELATION 
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REGRESSION ANALYSIS 

OFPENDENT VARIABLE P6 

RFSIDUAL STANDARD DEVIATION 27.1238 

STANDARD ERROR OF THE MFAN 3.2892 

MULTIPLE R 0.7860 

MULTIPLE RSQR 0-6178 



VARIABLE ENTERED 



VARIABLE 


B - COEF 


STO ERROR OF B 


PARTIAL-R 


BETA-COEF 


STO ERROR OF SETA 


P3 


2.9442 


0.2850 


0.7650 


0.7860 


U.0760 


CONSTANT 


26.0998 











SOURCE 



ANALYSIS OF VARIANCE TABLE 

O.F. SUM OF SQUARES MEAN SQUARE 



MEAN 


1 


0.21933E 06 


0.21933E 06 




DEGRESSION 


1 


0.78516E 05 


0.7B516E 05 


0.10672E 03 


ERROR 


66 


0.4SS56E 05 


0.73570E 03 
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REGRESSION ANALYSIS 

DEPENDENT VARIABLE P6 

RESIDUAL STANDARD DEVIATION 2S.0821 

STANDARD ERROR Op THF MEAN 3.0<<»16 

MULTIPLE R 0.B235 

MULTIPLE RSOR 0.678] 



VARIABLE ENTERED 



P4 



VARIABLE 


B - COEF 


STD ERROR OF B 


PARTIAL-R 


BETA-COEF 


STD ERROR OF 1 


P3 

P4 


2.8275 
1.7975 


0.2656 
O.SISO 


0.7971 
0.39.72 


0.7548 
0.2475 


0.0709 
0.0709 


CONSTANT 


21.7445 











SOURCE 

MEAN 

REGRESSION 

ERROR 



ANALYSIS OF VARIANCE TABLE 
D.F. SUM OF SQUARES 



1 

2 

65 



0.21933E 06 
0.86180E OS 
0.40892E 05 



MEAN SQUARE 

0.21933E 06 
0.43090E OS 
0.62911E 03 



0.6e493E 02 
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DEPENDENT VARIABLE P6 

RSSIDUAL STANDARD DEVIATION 23.9328 

STANDARD ERROR OF THR MEAN 2.9022 

MULTIPLE R 0.8435 

MULTIPLE RSOR 0.7115 



VARIABLE ENTERED 



P5 



VARIABLE 

P3 
P4 
P5 



CONSTANT 



1 - COEF 


STD 


ERROR OF B 


PARTIAL-R 


BETA-COEF 


STD ERROR OF 


1.9583 
2.3123 

1.0359 




0.4079 
0.5266 
0.3808 


0.5145 
0.4811 
0.3217 


0.9228 
0.3184 
0.2967 


0.1089 
0.0725 
0.1091 


2.9105 













SOURCE 



ANALYSIS OF VARIANCE TABLC 

O.F. SUM OF SQUARES MEAN SQUARE 



MEAN 


1 


0.21933E 06 


0.21933E 06 




REGRESSION 


3 


0.90415E 05 


0.30138E 05 


0.92617E 02 


ERROR 


64 


0.36658E 05 


0.57278E 03 





STEPWISE TEST ONE 



2222 



PAGE 



REGRESSION ANALYSIS 

DEPENDENT VARIABLE P6 

iRESIOUAL STANDARD DEVIATION 23.9726 

STANDARD ERROR OF THE MEAN 2.9071 

MULTIPLE R 0.8496 

MULTIPLE RSOR 0.7150 



VARIABLE ENTERED 



PI 



VARIABLE 

PI 
P3 
P4 
P5 



- COEF 


STD 


ERROR OF B 


PARTIAL-R 


BETA-COEF 


STO ERROR OF 


0.4272 
1.8967 
2.2333 

1.1167 




0.4813 
0.4145 
0.5349 
0.3923 


0.1111 
0.4994 
0.4654 
0.3375 


0.0635 
0.5063 
0.3075 
0.3200 


0.0715 
0.1106 
0.0736 
0.1124 



CONSTANT 



■1.2530 



SOURCE 



ANALYSIS OF VARIANCE TABLE 

O.F. SUM OF SQUARES MEAN SQUARE 



MEA\ 


1 


0.21933E 06 


0.21933E 06 




REGRESSION 


4 


0.90667E 05 


0.22716E 05 


0.39529E 02 




63 


0.36205E 05 


0.57468E 03 
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2.2 PRINCIPAL COMPONENTS AND FACTOR ANALYSIS 

The aim of factor analysis is to explain observed relationships among numerous 
variables In terms of simpler relations. This simplification can take the form of 
producing a set of classlflcatory categories, or creating a smaller set of hypothetical 
variables . 

The usual procedure Is to collect measurements on n variables, over N persons or 
objects (N should be appreciably larger than n). To find out "what goes with what" 
among these n variables , the n variables can be intercorrelated as they vary over the 
N objects. This Is done for all possible n(n-l)/2 pairings of the variables, producing 
a square symmetrical correlation matrix, R. 

The process of factor analysis (or principal component analysis) is designed to resolve 
this correlation matrix Into an n x k factor matrix. In which the number of factors, k. 
Is usually considerably smaller than n, the number of variables. These factors may be 
considered as underlying influences which, in further measurement, can be substituted 
for the more numerous original variables , and which largely account for the correla- 
tions among the latter. 

In analyzing the structure of a correlation matrix, two approaches can be taken. 
Formally, they resemble one another to a certain extent, but they have. In fact, rather 
different alms. One method Is principal component analysis; the other is factor analysis. 
The former method is a relatively simple technique of "breaking down" a correlation 
matrix Into a set of orthogonal (uncorrelated) components equal In number to the original 
variables. These correspond to the latent roots (eigenvalues) and accompanj^ng latent 
vectors (eigenvectors) of the matrix. The method has the property that the roots are 
extracted In descending order of magnitude; this Is important if only a few of the 
components are to be used for summarizing the data. These vectors are mutually 
orthogonal, and the components derived from them are uncorrelated. Although a few 
components may extract a large proportion of the total variance of the original variables, 
all components are required to reproduce the correlations between the variables 
exactly. Note that when the principal components method is employed, no hypothesis 
need be made about the original variables. They need not even be random variables, 
although. In practice, their values are usually regarded as a sample from some 
population. 

Factor analysis, on the other hand, seeks to account for, or "explain", the matrix of 
correlations by a minimum, or at least a small number, of hypothetical variables or 
factors. Factor analysis asks the question, "Does a random variable Fj exist such that 
the partial correlations between pairs of variables are zero after the effect of Fj has 
been removed?" If the correlation matrix Is still unexplained, the question Is asked 
whether two random variables, F, and Fg, exist so that the partial correlations between 
pairs of variables are zero after the effects of both of these variables have been removed, 
etc. Thus, It may be said that principal components analysis Is variance-oriented, 
whereas factor analysis is covariance-orlented. 

As has been noted above, the number of factors needed to explain the correlations is 
fixed by the data itself, in the sense that when the factor extraction process leaves a 
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residual correlation matrix of approximately zero, all of the covarlance present has 
been accounted for. 

However, this brings up the biggest problem in factor analysis. When a set of variables 
is interc or related, we have a set of n(n-l)/2 correlations. This leaves unanswered 
the question of what to put in the diagonal of the matrix, since we need a complete 
matrix for the process of factor analysis. Two solutions to this problem exist: (1) put 
ones in the diagonal — the method of principal components — on the grounds that, 
except for errors in measurement, a variable should correlate perfectly with itself; 
(2) insert values Into the diagonal known as communallties. (the term communallty 
means the amount of variance of the variable accounted for by all the common factors 
together) . This will obviously be less than the total variance, since some of the 
variance in any correlation matrix will be error variance, and some variance specific 
to that variable. This second solution is called factor analysis. 

Using the method of principal components. It is possible to account for many variables 
by a few factors, since the first few principal components usually account for most of 
the variance. However, unlike the factor analysis model, the variance accounted for 
will Include both specific factor and error variance. Factor analysis, in putting 
communallty estimates. Instead of ones, in the diagonal, attempts to partition the 
common factor variance from specific factor and error variance. 

Unfortunately, use of the factor analysis model leaves the problem of deciding what 
values to use for communallties. The communallty of a variable is the most that it 
has in common with other variables; thus, the squared multiple correlation of a variable 
with all of the other variables constitutes a lower bound on the communallty. The true 
communallty lies somewhere between the squared multiple correlation and one. To 
date, no method has been found of arriving at the "true" communallty. 

The problem is further complicated by the fact that the communallty estimates and the 
number of factors extracted are mutually interdependent; the communallty estimates 
chosen and the number of factors chosen determine when the residual correlation matrix 
drops to zero. Since, both of these values must be solved for simultaneously ~ and 
this is impossible — one has to start with one fixed and allow the other to be decided 
on by the program. Probably the best method to use is to fix the number of factors, 
and by Iteration find communallties that exactly fit the off-diagonals to give that number 
of factors. In other words, decide on a number of factors, insert the squared multiple 
correlations as Initial estimates of the communallties, and factor the correlation matrix, 
from which a new set of communallties is obtained; using these new values, refactor 
the matrix again. This process Is continued until the change in communallties between 
successive factorings becomes trivial. 

A final problem is deciding the number of factors to extract. In the absence of prior 
knowledge of the number of common factors In the correlation matrix, the safest 
course to adopt is Guttmann's lower bound theorem (1954), which demonstrates that 
eigenvalues with roots less than 1.0 are statistically Insignificant, so that one could 
use this to set an upper bound on the number of factors to extract. Another possibility, 
which can be used In conjunction with the method of principal components, is to extract 
components until a prespeclfled amount of the total variance In the correlation matrix 
has been extracted. This can be done most successfully when there is some idea as to 
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the amount of error variance in the correlation matrix (that is, the reliability of the 
measurements is known). Thus, a slightly smaller proportion of the variance can be 
extracted than is known to be common variance, since to take out more factors is to 
include error variance. 

In addition to finding out the number of factors (or components) required to account 
adequately for an observed set of variables, we may also be interested in finding out, 
or defining, what these variables are. When a predetermined number of factors are 
extracted from a correlation matrix, we have a matrix of factor loadings, with k 
columns (for the k factors), and n rows for the n original variables. These factor 
loadings for variables v^, V2, . . . Vjj on factors 1, 2, . . . k are the correlations of the 
newly discovered factors with the original variables. 

The concept of simple structure applies to the factor loading matrix. As has been 
pointed out above, the factor loading matrix consists of numbers such that each 
number corresponds to a given factor and a given variable. A particular element in the 
matrix indicates the extent to which that factor is represented in a given variable. 
However, the particular configuration of numbers obtained in an unrotated factor 
loading matrix is largely a function of the particular method used in extracting the 
latent roots and vectors of the correlation matrix, and may have no empirical meaning. 

The concept of simple structure was developed as a number of criteria for the 
orthogonal rotation of the original factor loading matrix into such a position that the 
factors extracted are readily identifiable in terms of the original variables. Simple 
structure is a nonmathematical concept that sets up several criteria for rotation. The 
first of these is the existence of a positive manifold. This means that — all other 
things being equal — the factor loading matrix should have a minimum number of 
negative values. But for many factor loading matrices corresponding to particular 
correlation matrices, we may still have a very large number of factor loading matrices, 
which equally well account for the intercorrelations, and which all have mostly 
positive values. To further restrict the selection of the particular matrix, by which we 
shall define the primary variables, we require that each column of the matrix shall have 
a small number of high factor loadings, and a large number of near-zero loadings. We 
also require that each row of the factor loading matrix shall have at least one near-zero 
factor loading, and that at least one of the others shall be large-positive. In general, 
the fewer the number of large loadings and the larger the number of near-zero loadings 
in a row, the more simple the structure of that particular variable. The more variables 
that can be expressed in the simplest form in terms of a relatively large number of 
near-zero loadings, the more simple is the structure of the factor loading matrix. 

However, the knowledge that there are a relatively large number of zeros in each row 
and column of the matrix of factor loadings is insufficient; the relative positions of the 
zeros and high loadings in the matrix^ must also be taken into account. For every pair 
of factors, the factor loadings should be arranged so that not many variables have high 
loadings on both. If variables have high loadings on the same factor, this implies that 
they tend to measure the same factor. Also, for any pair of factors, a number of 
variables should have high loadings on one factor and near-zero loadings on the other. 

According to these criteria, if the loadings of one factor were to be plotted against 
another, we should find that some variables would cluster about zeTo, some would be 
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high on one axis and low on the other, and vice versa for other variables. Thus, the 
procedure for finding the best simple structure matrix for any given set of variables 
would give an Indication of which variables were the best measures for which factors. 
The factors would then be defined in terms of the variables that have relatively high 
loadings on them. In other words, simple structure Is the application of Occam's 
Razor to the factor loading matrix, since it aims to explain the configuration of 
variables in such a way that each factor is represented by only a few variables (that is, 
it loads or correlates with the smallest possible number of variables). 

Practically, simple structure is realized by several computational techniques. The 
best known is the Varlmax rotation (Kaiser, 1958), which aims to maximize the fourth 
power of the factor loadings; this amounts essentially to maximizing the scatter among 
the loadings. Since a few highs means several lows, this leads to finding a position in 
which there are many low loadings. Thus, Varlmax alms to prevent a variable being 
simultaneously highly loaded on two factors. 

The Varlmax rotation retains the property of orthogonality among the factors (that is, 
the factors remain uncorrelated). In other words, the clusters of variables that load 
highly on each of the factors are essentially uncorrelated with one another. In actual 
practice, this seems rather unlikely. It would seem more plausible that the clusters of 
variables (or factors), which are obtained from a factor analysis, are probably 
correlated (positively or negatively) with one another. It is for this reason that oblique 
simple structure rotations of the factor loading matrix are performed. The c riteria 
for oblique simple structure are Identical to those for orthogonal simple structure, with 
the exception that the orthogonality restriction is relaxed (that is, the factors need not 
be uncorrelated with one another). Basically, rotation to oblique simple structure is 
achieved by first performing a Varlmax rotation, and then using the Varlmax factor 
loading matrix to rotate obliquely. The effects of oblique rotation are usually to 
maximize the high loadings on each factor and minimize the near-zero loadings. The 
clusters of variables on each factor, as derived from the Varlmax rotation, will not be 
altered; the effect simply Is to give a "cleaner" solution. 

When an oblique rotation is used, the situation is rather more complex than in the 
orthogonal case. There are, in fact, three matrices that must be understood in relating 
factors and variables: 

1. The factor structure matrix, which gives the correlations between factors and 

variables 

2. The factor pattern matrix, which gives the loadings of factors on variables 

3. The factor estimate matrix, which gives the beta weights for estimation of factors 
from variables 

The final feature is the estimation of factor scores, for both the orthogonal and the 
oblique case. When a given number of factors have been extracted from a large number 
of variables, and they have been identified by rotation of the factor loading matrix, it 
may be desirable to calculate, for each observation, a set of factor scores, in place of 
the scores on the original variables. These scores are a weighted summation of the 
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original scores on each of the variables for a given observation. These scores can 
then give a profile score for each observation over the factors extracted. 

2.2.1 Mathematics of Principa l Components and Factor Analysis 

Principal Components Analysis 

Let us consider n points in a space of p dimensions, when the x's are expressed in 
standard score form (that is, mean = 0; variance = 1). The line with current 
coordinates X is 



X^-m^ 


^2-^2 


X -m 
P P 


^1 


h 


^P 



(1) 



where g's are direction cosines, and are subject to the condition 

P 2 

2:^1 = 1 <2) 

i=l 

The sum of squares of the distances from the n points on to this line is nS, where 



(3) 



n p 2 P 2 

nS= E (E i^if^i) - (ESi O^if^i)) 
j=l i=l •■ 1=1 •" 

If this is a stationary value, the partial derivatives with respect to the m's vanish, 
and 

- S (x..-m.) +2 g.2:g.(x -m.) = 0, i = 1, 2, . .p (4) 

J ^ J i 

and since 2 x.. = 0, m./g. = k (a constant). 
11 11 

] 

Thus, the origin lies on the line (1), and we may take all the m's to be zero, thus 

E X. . = n, and we have 

n P „ P 
nS=E (Exj. -(EgiV> 

j=l L=l •• i=l 

n P „ 

= np-E (ESiV (5) 

j=l 1=1 •• 
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Then we can find stationary values of S for variations in g, subject to equation (2) above. 
If, we consider X , an undetermined multiplier, this gives us 



11 

l/nX)\.(2g.\.) + Xg, = 0, k=l,2, ...p 



(6) 



which gives us the set of p equations 



gl(l-X) + g2r^2+...gprjp = 



^iV^Vp2-'"-^Vi-^) = « <^> 

Eliminating the g's, we get the characteristic equation of the correlation matrix 

-XI =0 (8) 

For a known r, this gives p roots in X . To each root corresponds a set of g's for 
which S has a stationary value. Also, using equation (6), we find from equation (5) 

S = p- X (9) 

It follows from equation (9) that the root which gives the minimum S is the one with the 
largest X . If we choose the largest root of equation (8), we have the line required. The 
sum of squares of distances of the points from it is a minimum, and the variate 
measured along it has the maximum variance. The variate is given by 

V^ = E^if 3 (10) 

This indicates that the set of g's relates to Xj . If we multiply, equation (6) by xj^, and 
sum over k, we can see that the variance of V, is X^^. 

If we now look for the direction (perpendicular to the first line), for which the sum of 
squares of perpendiculars is at a minimum, we find the line corresponding to X , 
the second largest root, etc. 

Thus, we have transformed to a new set of variates, V, that are uncorrelated, and 
have variances X , X „, . . . X in decreasing order. 

Note that p = 2X, since the sum of the roots is the sum of p units in the main diagonal. 
Also, if the original variables are normally distributed, we can regard the V's as 
splitting off independent components of variance X , X „, ... X , from the total 
variable, p. ^ 
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Thus, we can select from this set of p variates, V, the first n components and consider 
these as our factors. In general, the two main criteria for deciding on the number of 
components to retain are (a) when the value of the X's falls below 1. 0; or (b) when the 
first n components account for a fixed percentage of the total variance. 

Factor Analysis Model 

Basically, the mathematics and computational steps in factor analysis are similar to 
those required by the method of principal components. The difference lies in the fact 
that in component analysis we begin with a set of observations and look for components, 
in the hope that we shall be able to effect a reduction in the dimensions of variation, 
and that we can give some physical meaning to the components thus extracted. Using 
the factor analytic model, we begin with a theoretical model, and try to find out whether 
it agrees with the data, and if it does, to estimate its parameters. 

Let us begin, as in the method of principal components, with a matrix of observations 
xy, and consider whether they can arise from a situation with the following structure: 

P 

''i = SV^k ^ h ^ "" °i^i' ^^^^^ i = 1. . . P (1) 

k=l 

In this equation (1), the fj^ are factors that can appear in more than one x, s- is a 
factor specific to the variable xj, and e^ is an error term. 

At this level, the model is undetermined, and, in fact, by using the method of principal 
components, we can always express the x's In terms of f's without invoking specific or 
error terms at all. This is the basic difference between principal components and 
factor analysis. In the former, we consider all the variance, common variance, 
and extract its orthogonal components. In factor analysis, on the other hand, we take 
into account that some of the variance is going to be due to error, and some to variance 
that is quite specific to a certain variable. In this sense, the factor analytic model is 
more realistic, and the principal components method, in spite of its mathematical 
simplicity is misleading. 

Therefore, let us assume that we have n observations on p variables x^. Using the 
method of principal components, we have 

S = 2 var X. - 2 gyg.^cov (x^ , x^^) (2) 

Thus, the principal components equations are 

2ir^<^j' v=^gik (3) 
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However, in the factor analysis model, if 



X.. =Sa., f, . 
I] ^ ikk] 



cov(x.,x.)= 2_^a.^a^l/n2;fj^.f^. (4) 



k,m j 

and if we substitute its expected value for S \^^^ 

d^=l, ifk = m 

= 0, if k ?^ m 



we have 



cov(x.,x)==2a.j^a^ 
k 



(5) 



If the model is 



we have 



X.. =2a., f, . +e.. (6) 

ij ik k] 1] 



cov(x. , X.) = 2 a., a., + var e d 
^ 1 ]' ik ik 11 



(7) 



jk 

Now we are required to estimate the coefficient a^y We can operate on the estimated 
matrix 

2 a., a, + d. var e. 
ik k 1 i| 

This is the same as the former matrix, except for the principal diagonals, where each 
term is increased by var e. . Thus we would like to have in the main diagonal not 

2a^ + var e . but only S a^. . In other words, if we are not to bias the estimates of the 

ik i' ik 

a's, we must remove var e from the diagonal terms. This is equivalent to substituting 
communalities for unity in the diagonals of the standardized matrix. 

Possibly the best way of estimating the communalities is to start with the squared 
multiple correlations in the diagonal (since this is a lower bound on the communalities). 
We then perform an analysis of the data and arrive at certain factors (deciding on the 
number of factors, by taking those with latent roots >1. 0, those factors accounting for 
a certain percentage of the variance, or some other method). We can then use the 
coefficients occurring in those factors to estimate new communalities, iterate, and 
proceed until the communalities converge. Basically, what this process amounts to is 
that we assume m factors and assume that they account for as much as possible of the 
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variance; this determines the communalities and, consequently, the "error" variances. 
But this does not mean that we have estimated the actual error variances that occur in 
practice. We have estimated only what they would be if the number of factors is what 
we think it is, and the error variances are minimal. 

In other words, this would suggest that in practice care should be exercised in 
computing a factor analysis. If one has no idea of the number of factors to extract, 
possibly the best solution is to compute a principal components solution of various 
numbers of factors, rotate, and decide which set of factors gives the best empirical 
meaning. Then, using this number of factors, estimate the communalities, and run 
a proper factor analysis. 

Rotation of the Factor Loadings 

In using the Varimax criterion for rotation to orthogonal simple structure, we have 
already defined verbally what we mean by simple structure. Mathematically, the 
simplicity of the factorial composition of the jib variable can be defined as the variance 
of the squared loadings for the test 

q* = (r2(aV-(Sa^g)Vr^ (1) 

•• s •" s •' 

where j = 1, 2, . . . n variables, and s = 1, 2, ... r factors, and ajg is the factor 
loading of the j^ variable on the stb factor. 

To obtain the total criterion for the entire factor matrix, we can sum over the variables 
thus: 

q* = 2 (r2 (af )^ - (2 af )^)/r^ (2) 

j s ^^ s ^' 

This criterion can be modified if we define the simplicity of a factor as the variance 
of its squared loadings 

v* = (nS (aV-(2af )Vn^ (3) 

s . js . js 

and for the criterion for all the factors, define the maximum simplicity of a factor 
matrix as the maximization of 

V* = z V* - 2 ((n 2 (a^ )^)/n' 
s s ] •" 

which is the variance of squared loadings by columns rather than by rows. 

This is the row Varimax rotaticm. However, this will exhibit a systematic bias 
because of the divergent weights that implicitly are attached to the variables by their 
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communalities. Therefore, the normalized Varlmax rotation weights each variable by 
Its communality, thus: 

V = 2 ((n S (af /hf )2 - ( S (af /hf ))^)/n^ (4) 

2 th 

where hj is the communality of the j— variable. In this case, the variance of the 

squared correlations of the common parts of the variables with a factor are now being 

maximized. 

The oblique rotational scheme is developed from the above normalized Varimax 
solution. The Promax rotation simply takes the Varlmax-rotated factor loading matrix 
and generates a pattern matrix from it by powering all the elements in the original 
matrix. 

We can define a matrix P = (p..) such that 

ij 



^iJ 



k+1 
a.. 



/ ay (S) 



with k > 1. Each element of this matrix is, except for the sign that remains unchanged, 
the k^fe power of the corresponding element in the row-column normalized orthogonal 
matrix. We then find the least-squares fit of the orthogonal matrix of factor loadings 
to the pattern matrix generated by equation (5). 

L = (G'G)"-^G'P (6) 

where L = the unnormalized transformation matrix of the reference vector structure, 
G = the orthogonal-rotated matrix, and P = the matrix derived by equation (5) above. 
Finally, the columns of L are normalized so that their sums of squares are equal to 
unity. 

Computation of Factor Scores (Direct Estimation) 

Factor scores can be computed for each observation on the factors extracted from the 
original correlation matrix. (See Harman, 1960, Chapter 16, in list of references at 
end of this chapter. ) These are computed using the following equations : 

Let F = matrix of factor loadings 

V = the orthonormal matrix of eigenvectors 

A = diagonal matrix of latent roots (eigenvalues) 



Then 



F = VA^/^ (1) 
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F is an orthogonal matrix (but not orthonormal). Since V is orthonormal 

V = V"^ (2) 

From the principal components model we know 

Z = BS + US + eS (3) 

where Z = vector of scores for each observation 
B = matrix of common factor loadings 
U = diagonal matrix of uniqueness (1-h ) 
e = diagonal matrix of errors 



Therefore 



since 



so 



S = f'^^'Z (4) 



F-^=V-V^/2 

= VA (5) 



F"'^ = A"-^F' (6) 

S =A"-^F'Z (7) 



Therefore, the factor score for an observation on factor 1 would be 

^^fll^l/^l"V2/^-^--v+Vp/Xl (8) 

TERMS USED IN FACTOR ANALYSIS 

Communality . Sum of squares of factor loadings for any given variable (that is, the 
total variance due to factors which this variable shares with other variables in the 
matrix) . 

Covariance . Mean product of deviations of variable x and variable y from their means 
(1/n) S (x-x) (y-y). 
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Diagonal matrix. A square matrix having zeros in all positions except those on the 
diagonal from upper left to lower right. 

Direction cosine. One of a set of cosines of aisles, defined for a point, each angle 
beii^ measured between one of the reference axes and the vector connecting the point 
with the origin. 

Factor loading. Correlation of any particular variable with the factor being extracted. 

Factor matrix. Matrix whose entries are the factor loadings obtained from a factor 
analysis; it generally is arranged so that it has as many columns as factors extracted, 
and as many rows as variables . 

Hyperplane. Space of (N-1) dimensions, defined by a reference vector perpendicular 
to it. (For example, in two dimensions, either coordinate axis is the hyperplane of 
the other; in three dimensions, the plane defined by any two coordinate axes is the 
h3T)erplane of the third. ) 

Normalize. To divide each of a set of numbers by the square root of the sum of squares 
of all numbers in the set, so that the sum of squares of the new set is 1. 00. 

2.2.2 The Program 

Given a set of observations numbering 499 or fewer containing measures on n ^30 
variables, Xj, X2, . . -x.^, a square symmetric n x n correlation matrix, R, and vectors 
of means and standard deviations are computed. From this or a given correlation 
matrix, a factor matrix is extracted containg n or fewer vectors of factor coefficients. 
This factor matrix may be rotated to approximate simple structure by an analytical 
criterion in either an orthogonal or an oblique reference frame. Given the original 
data, X, together with its means and standard deviations, this rotated factor matrix, G, 
may be used to compute factor measurements (factor scores) by a regression model. 

2 
Communalitles, h. , are treated as the diagonal elements of the correlation matrix. 

These elements are computed equal to 1. 0, and should be retained as such for the 

computation of the principal components factor matrix. They may be specified by some 

predetermined values, however, where a specially constructed correlation matrix 

is given rather than carried over from previous computation. For example, the user 

may desire to place specific communality values on the diagonal of this matrix (see 

section 2.2.6). Options are also available to consider each 1— communality as the 

maximum absolute off -diagonal element in the i— vector of the correlation matrix or 

as the squared multiple correlation for the i— variable. 

All n of the latent roots of the correlation matrix with diagonal elements chosen as 
indicated above are computed by a Householder (HOW, 1962) tridiagonalization, followed 
by the use of the QR algorithm. The k latent vectors are computed by Wilkinson's 
(HOW, 1962) method. These latent roots (eigenvalues) are solutions to the matrix 
equation 

(R-X) A* = 

where R is the correlation matrix, X is a diagonal matrix of the latent roots, and A* 
is a matrix of the latent vectors (eigenvectors) . 
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The total variance accounted for by the principal components of the correlation matrix 
is evaluated by its trace (the sum of its diagonal elements). The percentage of this 
total variance accounted for successively by each latent root is computed and presented 
cumulatively for the first through the ntS root. This percentage is presented whether 
or not a principal components analysis (r^ = 1) is being performed. If r^ -^ 1, the 
output should be ignored. The latent vectors, a?, are normalized, and a matrix, F, of 

factor loadings is computed by scaling each latent vector by the square root of its 
associated latent root, that is. 



where the f are factor loadings, the a., are elements of the latent vectors, and the 

X , are latent roots . 
J 

Several methods are available to the user for estimating the rank, m, of the factor 
space for the purpose of retaining only m factors for output or subsequent rotation. The 
value of m may be specified on a control card and arbitrarily accepted as the maximum 
number of factors . The user may also request that only those factors whose latent 
roots are equal to or greater than 1. be retained. An option is also available to retain 
only those factors which cumulatively account for an amount of variance equal to or less 
than a. given percentage of the total variance. This option could be used in a principal 
components analysis. 

The matrix of factor loadings may be rotated to approximate simple structure in an 
orthogonal reference frame by the Normal Varimax method (Kaiser, 1958) for the case 
of uncorrelated factors; k factors are rotated where k is equal to or less than m, the 
rank of the factor space as determined above. The Normal Varimax method develops 
a transformation matrix, T, over a cycle of rotations of each of the fek-1) pairs of 
orthogonal axes of the factor space taken in turn. The angle of each rotation is 
chosen such that a function, U, of the factor matrix is maximized. Complete cycles 
of rotations are performed until U is not significantly increased by an additional cycle. 
U is computed by an evaluation of the following expression: 



U 



n k 
i=l j==l 
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k 

■E 


r 2 n 
n g.. 

i=l h . 
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L ] J 



where k is the number of factors, n the number of variables, and g.. an element of the 

factor matrix under rotation for the %— variable on the j— factor; h . represents the 

th ^ 

communality of the i— variable computed using only the k factors under rotation. The 

final rotated factor matrix, G, is derived by the matrix multiplication, G = FT, where 

T is the complete Varimax transformation matrix, and F is the unrotated factor matrix. 

This matrix of k factors may also be rotated to approximate simple structure in an 
oblique reference frame by the Promax method (Hendrickson and White). A pattern 
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matrix, Pt describing a factor matrix rotated to approximate simple structure In 
oblique axes, may be accurately estimated by a matrix whose elements are functions 
of the elements of the orthogonal matrix rotated by the Varimax method. This matrix 
can be derived by the following operation: 



Pf. = 



a+1 



13 S,. 

where Pf^ is an element of the pattern matrix, P* and g^j is an element of the 
orthogonally rotated factor matrix, G. The value of a is four (4). According to 
Hendrickson and White (1964), four is the optimal value in the majority of cases. 
The user can, however, easily change this number In the program PRO MX. In general. 
as a Increases, the dependence of the rotated factors or their obliquity increases. A 
transformation matrix is computed that rotates the orthogonal factor matrix into an 
oblique reference vector structure matrix, V, which is a least-squares fit to the 
pattern matrix, Pf described above. This transformation matrix, L, is derived in 
unnormalized form from the following matrix equation: 

L = (G'G)"'''G'P.* 

After the transformation matrix, L, has been column-normalized, the reference 
vector structure matrix, V, Is obtained from V = GL. The correlation matrix of the 
reference vectors, i , is computed by\^= L'L, and the reference vector pattern matrix, 
W, Is then developed by W = V^~'^. To derive the primary factor structure from the 
reference vector solution described above, the diagonal matrix, D, of the correlations 
among the reference vectors and the primary factors Is computed by taking 



where the d are diagonal elements of D, and c. are diagonal elements of the matrix, 

li " 

^~ . The primary factor structure matrix, S, is then determined by S = WD, and the 
primary factor pattern matrix is derived by P = VD"!. The matrix of correlations 
between the primary factors, * , Is computed by * = Df'^D. 

Factor measurements (factor scores) are computed by the "short" regression method 
(Harman, 1960). The diagonal matrix of uniquenesses, U, Is obtained by taking 

u = 1-h^ where the h are the communalltles computed from G, the orthogonal factor 

II I 1 

matrix, or P, the oblique factor matrix, depending on which scores are requested. For 
the case of uncorrelated or orthogonal factors, the matrix, Q, Is developed by 

Q = I + G'U~'''G, where G Is the orthogonal factor matrix (Varimax solution). Factor 

scores are formed by the operation f = /3' Z, where f Is a factor score matrix, ^ is a 

matrix of factor score regression coefficients, and Z the vector of standardized data. 

/3 Is obtained by the operation /3' = Q"''"G'U~ . The elements of Z are computed by 
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X .-X. th 

z = ^ •* where x. is an observation in a data matrix for the k— sample case on 
kj s Tij 

the j— variable, and x. is the mean and s. the standard deviation of the j— variable. 

J J 

For the case of oblique or correlated factors, the procedure is much the same, except 
for the definition Q = *~^ + P'u'''^P, where P is the primary factor pattern matrix and 
* the matrix of intercorrelations of the primary factors. Also, here, /3' = Q P'U . 

2.2^3 Summary of Output Statistics 

1. High and low value of each variable 

2. Means of each variable 

3. Standard deviation of each variable 

4. Sample variance for each variable 

5. Matrix of raw cross products 

6. Matrix of residual cross products 

7. Variance-covariance matrix 

8. Matrix of correlation coefficients 

9. Matrix of characteristic vectors 

10. Characteristic values 

11. Trace 

12. Cumulative percentage of trace of each characteristic value 

13. Unrotated factor matrix 

14. Orthogonal transformation matrix 

15. Orthogonal factor matrix 

16. Transformation matrix to oblique reference vector structure 

17. Oblique reference vector structure matrix 

18. Correlations among oblique reference vectors 

19. Oblique reference vector pattern matrix 

20. Oblique primary factor structure matrix 

21. Correlations among oblique primary factors 

22. Oblique primary factor pattern matrix 

23. Factor score regression coefficients 

24. Factor scores 

25. Communalities 
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2.2.4 Job Execution 

To perform a factor or principal components analysis, the user must supply three sets 
of cards to the program: 

1. Monitor control cards 

2. Program control cards 

3. Data cards 

Descriptions of the form and content of each card set follow. 

MONITOR CONTROL CARDS 

The monitor control cards are necessary to initiate program loading from the disk and 
to establish the necessary communication with the monitor, A general description of 
the cards may be found in IBM1130 Disk Monitor Reference Manual (C26-3750). 

A factor analysis requires the following monitor cards: 



CC: 1 4 8 


16-17 


// XEQ FCTR 


04 



*LOCALFCTR, FMTRD, DATRD, PRNTB, MXRAD, TRAN 

♦LOCALFCTRl, TRIDI, QR, INVRS 

*LOCALFCTR2, VECTR, PRNT 

♦LOCALFCTR3, VARMX, PROMX, SCORE, RFOUT 

*LOCALCOREL, PRNT 

The monitor control cards do not change from job to job within one analysis, but must 
be included with every job processed. The first program operated on by this system 
should be preceded by a cold start card. 

PROGRAM CONTROL CARDS 

The program control cards communicate the data- specific parameters and output 
options to the program. There are five possible card types necessary for execution: 

1. Input/output units card* 

2. Job- title card* 

3. Option card (described below) 

4. Variable name card (described below) 

5. Variable format card* 

Four of the control cards are required in every job. The variable format card is 
necessary only if source data is to be processed. 



*See "General Operating Instructions", section 1.2. 
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OPTION CARD 

Number of Variables (cc 1-2) 

This field must be punched with a nonzero integer, n, which is less than or equal to 30. 
The value contained in n is the total number of variables to be processed. 

Input Type and Source (cc 3-4) 

This field allows the user to specify the input device (1442 card reader or disk) and, 
indirectly, the type of input analysis to be undertaken in the input program. The three 
possible values that may be punched in this field are described below: 

Value Meaning 

1 Raw data will be read from the 1442 card reader and transferred 
to the disk. It will be retained there for use by this or other 
programs until destroyed by input from one of the four programs 
in this system. Raw sums and raw sums of cross products will be 
accumulated. Data will be read until a card with a negative number 
in the identification field is encountered (section 2. 2. 5). 

2 Raw data will be read from the disk. Raw sums and raw sums of 
cross products will be accumulated. Data will be read until a 
negative integer in the identification field is encountered. 

3 A previously computed matrix, or matrices, will be read from 
the 1442 card reader. Matrix cards will be read until a negative 
job number field is encountered (see "Pooling", section 2.2.6). 

Sequence Checking (cc 5-6) 

This field is used to indicate that raw data input from the card reader (cc 3-4 contains a 
1) is to be sequence-checked. A value of zero or a blank field implies that no sequence 
check will be made. A value of one (1) implies that the cards will be sequence-checked. 
The sequence-checking process consists of an equal comparison check of the case 
identification field for all cards in a case and an ascending sequence check of the card 
number field. If an error in either of these conditions is encountered, the program 
prints a message, and the job is terminated. 

Number of Variables on Card 1 (cc 7-8) 

When a data vector contains more variables than will fit on one card, the user must 
Indicate to the program the number of variables punched on each card. This field must 
be punched with the number of variables on the first card. If there is only one card 
per case, this field must be blank or zero. 

Number of Variables on Card 2 (cc 9-10) 

Same as cc 7-8, except that this field indicates the number of variables on the second 
card of the data. 
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Number of Variables on Card 3 (cc 11-12) 

Same as cc 7-8, except that this field indicates the number of variables on the third 
card of the data. 

Transformation Switch (cc 13-14) 

If the value in this field is nonzero, a user-written transformation subroutine is called 
after each data record is read and before any computation takes place. 

If the value in this field is zero or blank, the transformation subroutine is not called. 

The use of transformations is discussed in section 2. 5. 1. 

Output Raw Sums of Cross Products (cc 15-16) 

This field is used to indicate whether the raw sums and sums of raw cross products 
matrix are to be printed, punched, printed and punched, or not presented. 

The four (4) possible values of this field are described below. The computation to 
generate the ma:trlx is performed even if the "no output" option is chosen. 

Value Meaning 

or blank No output. 

1 Matrix will be printed. 

2 Matrix will be printed and punched. 

3 Matrix will be punched. 

Punched output of the raw sums of cross products matrix includes the number of 
observations and the vector of raw sums and sums of squares. This entire output 
must be entered on the pooling option (section 2.2.6). 

Output Residual Cross Products ( cc 17-18) 

This field is used to indicate whether the residual cross products matrix — defined 
as: 

s s 
•^ij=^lj-4r 1.3 = 1.2.. .n 



where c are the elements of sums of raw cross products matrix, and s , s are the 
ii * J 

raw sums of the i— and j— variables, respectively, and n is the number of cases — i 
to be printed, punched, printed and punched, or not presented. 



The four (4) possible values are described above under "Output Raw Sums of Cross 
Products". 

The matrix Is computed even if the "no output" option is chosen. 
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Output Variance-Covariance M atrix (cc 19-20) 

This field is used to indicate whether the varlance-covariance matrix — defined as: 



^u= i,j = l,2...n 

•" n-1 



where u^j is an element of the residual cross products matrix, and n is the number of 
cases — is to be printed, printed and punched, punched, or not presented. The four 
(4) possible values that may occur in this field are as is given for the above matrices. 

There are no additional vectors or matrices punched with the punched output. The 
matrix is computed even if the "no output" option is chosen. 

Output Correlation Matrix (cc 21-22) 

This field is used to indicate whether the correlation matrix — defined by: 

c.. 
r =-^ i.i = 1.2...n 

where c.. is an element of the variance-covariance matrix, and s., s. are the standard 
deviations of the i— and j— variables, respectively - is to be printed, punched, 
printed and punched, or not presented. The four (4) possible values contained in this 
field are as is given for other matrices, above. 

The punched output of the correlation matrix includes the number of cases and cards 
containing the vectors of means and standard deviations. 

The matrix is generated even if the "no output" option is chosen. 
Factor Scores (cc 23-24) 

This field is used to indicate whether factor scores are to be computed. If a value of 
zero (0) is punched or the field is left blank, the factor score computation is suppressed 
When this field contains a one (1), factor scores and factor score regression coefficients 
are computed. A two (2) in this field causes scores to be punched. Upon entry to the 
program SCORE, which computes the scores, the program assumes that the necessary 
matrices and data have been set up for the analysis. Hence, either an orthogonal 
or an oblique rotation must be performed before entry to the SCORE routine. The 
number of scores to compute is equivalent to the number of rotated factors. Hence it 
is not possible to compute factor scores from the unrotated principal axis factor matrix. 
In addition to the factor matrix and an auxiliary matrix computed by the rotation output 
program, the scores program requires the data file to be on the disk and the means and 
standard deviations vectors to be located in common storage. If the entire factor 
analysis is being done from the raw data, these operations are performed automatically 
by the program. 
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Factor Score Punched Output Format: 
Card I 

Columns Elements 

1-4 Factor score number (I) 

5-6 25 (Identifier) 

7-20 Score for variable 1; ± .XXXXXXXE±XX 

21-34 Score for variable 2; " 



63-76 Score for variable 5; " 

If more than five factors have been rotated, card I + 1 has a format as follows: 

Columns Elements 

1-6 Blank 

7-20 Score for variable 6 



The factor scores are computed from the Varimax solution if an oblique rotation has 
not been requested; otherwise, they are computed from the oblique solution. 

Number of Factors to Compute (cc 25-26) 

The number punched in this field Is used as a switch setting in the program to determine 
the number of factors to compute from the characteristic roots and vectors. There are 
four (4) possible values that may be punched, and they are described below: 

Value Meaning 

or blank No factors will be computed. 

1 Only those factors will be computed whose characteristic 
vectors have associated characteristic roots greater than or 
equal to one (1). 

2 Compute a fixed number of factors (m). The value of m will 
appear in cc 27-28; m must not be greater than ten. 

3 Compute factors whose variance accounts jointly for no more 
than P percent of the total variance. The value of P appears 
In cc 27-28. The variance of a factor Is the characteristic 
root associated with a particular characteristic vector. The 
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Value Meaning 

3 (cont) total variance is defined as the trace of the matrix. The 

percentage is computed by adding characteristic roots and 
forming the ratio of this sum to the trace of the communality- 
adjusted correlation matrix. 

Constant for Number of Factors (cc 27-28) 

This field is used in conjunction with cc 25-26. A two (2) in the previous field implies 
that this field will contain an integer, m, which is equal to the number of factors to 
compute. If cc 25-26 contains a three (3), this field should contain an integer, P, 
which is the percentage of factor variance. 

Communality Estimation Options (cc 29-30) 

This field is used to offer the user a choice of three methods of estimating the 
communality or common variance of the reduced factor space. Before the characteristic 
roots and vectors are computed, the program places the communality estimate on the 
principal diagonal of the matrix to be factored. Three possible values may be punched 
in this field, and they are described below. Iteration on communalities is not performed 
automatically, and is discussed in section 2.2.6. 

Value Meaning 

No change to the matrix. 

1 The absolute value of the largest off-diagonal element in a row 
will be used as the communality estimate for that variable. 

2 The square of the multiple correlation coefficient between variable 
i and all other variables in the matrix will be used as the 
communality estimate for the iili variable. This is done for all i. 

Rotation Switch (cc 31-32) 

This field is used to indicate the type of rotation to simple structure that will be used 
on the principal axis factor matrix. The user has the choice of choosing an orthogonal 
rotation (normal Varimax) and/or an oblique rotation (Promax) . The process by which 
an oblique rotation is computed requires that an orthogonal rotation be performed first. 
Hence, in addition to the oblique rotation matrices, the user has the option of obtaining 
the output of the orthogonal rotation. Three possible values may be punched in this field, 
and they are described below: 

Value Meaning 

or blank No rotation will be performed. 

1 Orthogonal rotation. 

2 Oblique rotation (includes an orthogonal rotation). 
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Number of Factors to Rotate (cc 33-34) 

This field is used in conjunction with the rotation switch described in the previous field. 
The value punched in this field determines the number of factors to rotate. Two 
possible conditions can arise. If the user does not know the number of factors to 
rotate, it is suggested that the field be left blank (or zero). The number of factors to 
rotate is then chosen on the basis of one of the options in cc 25-26. However, if a 
value of k appears, k factors are rotated if this number is less than or equal to the 
number of factors computed. In any case, k must be less than or equal to ten. 

Pooling Option (cc 35-36) 

When using the matrix input/output option (03 in cc 3-4) and when pooling sums of squares 
and cross products (section 2. 1.4), if the user desires that matrices be subtracted 
rather than added, this field should be nonzero. 

Factor Matrix Output Option (cc 37-62) 

In a complete factor analysis, there are 13 additional matrices (section 2. 5. 3) that the 
user has the option to output, if desired. The 13 remaining fields on the card are for 
this purpose. 

Each of the two-column fields may take four possible values, described below: 

Value Meaning 

or blank No output. 

1 Print matrix. 

2 Print and punch matrix. 

3 Punch matrix. 

The following gives the name and field column numbers for each matrix: 

Column Matrix 

37-38 Characteristic vectors. A* 

39-40 Unrotated factors, F 

41-42 Orthogonal transformations, T 

43-44 Orthogonal factors, G 

45-46 Transformation to oblique reference vector structure, L 

47-48 Oblique reference vector structure, V 

49-50 Correlations among oblique reference vectors,^ 

51-52 Oblique reference vector pattern, W 

53-54 Correlations between reference vectors and primary 

factors, D 

55-56 Oblique primary factor structure, S 

57-58 Correlations among oblique primary factors,* 

59-60 Oblique primary factor pattern, P 

61-62 Factor score regression coefficients, 
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Factor Analysis Option Card Summary 

Column Meaning 

1-2 Number of variables 

3-4 Input type, and source 

1 - Raw data input from card reader 

2 - Raw data input from disk 

3 - Matrix input from card reader 

5-6 Check sequence of raw data input 

- No 

1 - Yes 

7-8 Number of variables on card 1 

9-10 Number of variables on card 2 

11-12 Number of variables on card 3 

13-14 Transformation switch 

- No transformation 

1 - Transformation 

15-16 *Output raw cross products matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 

17-18 *Output adjusted cross products matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 

19-20 *Output variance-covariance matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 

21-22 *Output correlation matrix 

- No 

1 - Print 

2 - Print and punch 

3 - Punch 



* Not available when correlation matrix is used as input. 
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Column Meaning 

23-24 Factor score options 

- Do not compute factor scores. 

1 - Compute and print factor scores. 

2 - Compute, print, and punch factor scores. 

25-26 Number of factors options 

- Do not compute factors. 

1 - Compute factors for latent roots >1. only. 

2 - Compute m factors (where m is given in cc 27-28). 

3 - Compute factors accounting jointly for no more 

than p percent of the total variance (where p is 
given Incc 27-28). 

27-28 Constant for number of factors option, if appropriate 

29-30 Communality options 

- Use diagonal values of correlation matrix 

(normally unity unless otherwise specified in 
a given matrix) . 

1 - Use maximum absolute off-diagonal element 

in each vector of the correlation matrix. 

2 - Use the squared multiple correlation 

coefficient for each variable. 

31-32 Rotation options 

- Do not perform any rotations. 

1 - Perform an orthogonal rotation (Varimax) only. 

2 - Perform an oblique rotation (Promax, 

including Varimax). 

33-34 Constant for number of factors to rotate 

- Rotate the number of factors determined by 

the option chosen in cc 25-26 above, 
k - Rotate a number of factors equal to the minimum 
of k, ten, and/or the number of factors 
determined by the option above in cc 25-26. 

35-36 Pooling option (see Sections 2. 5. 3 and 2. 2. 4) 

00 - Add matrices with ID = 1 
Nonzero - Subtract matrices with ID = 1 
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Column Meaning 

Note : In columns 37-60, the matrix output options are as follows: 

- No output 

1 - Print only 

2 - Print and punch 

3 - Punch 

37-38 Output the latent vectors. A* 

39-40 Output the unrotated factor matrix, F 

41-42 Oulput the orthogonal transformation matrix, T 

43-44 Output the orthogonal factor matrix, G 

45-46 Output the transformation matrix to oblique 

vector structure, L 

47-48 Output the oblique reference vector structure 

matrix, V 

49-50 Output the correlations among oblique reference 

vectors,^ 

51-52 Output the oblique reference vector pattern 

matrix, W 

53-54 Output the correlations between reference vectors and 

primary factors, D 

55-56 Output the oblique primary factor structure 

matrix, S 

57-58 Output the correlations among oblique primary 

factors , * 

59-60 Output the oblique primary factor pattern matrix, P 

61-62 Output the factor score regression coefficients, /3 

VARIABLE NAME CARD 

In the factor analysis program there are a number of matrix printouts that the user may 
request. The variables in the matrix may be assigned a four-character name to aid in 
the identification of the output. The card is punched in four-column fields, and each 
field corresponds to the variable to be identified (for example, field 3 (columns 9-12) 
will be the name of row and column 3 on all matrix output). At most, 20 names can 
appear on one card. If there are more than 20 variables in the analysis, a second card 
having the same format as the first must be included in the control card deck. 
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Column 



Meaning 



1-4 

5-8 


Name of variable 1. 
Name of variable 2. 


(4N-3) - (4N) 
Data Input 


Name of variable N. 



2,2.5 

Raw data input to the program consists of a set of observations made on several 
different variables. The variables for each observation are punched on one, two, 
three cards, according to the following general format: 



or 



Field 



Type Meaning 

Integer (I) Identification field. Any numeric information that 
serves to identify the particular observation is 
punched in this field. It must be greater than zero, 
and should be different for each observation. 

Integer (I) Card number within observation. If it is not possible 
for one card to contain all the variables, they may 
be continued on a second and a third card, as 
necessary. The user has the option of sequence 
checking the cards to ensure that all cards within a 
case are together, and that the order of cards is 
consistent. If the option is chosen (cc 5-6 on option 
card), this field must be punched with an integer 
that is in ascending sequence for all cards in the 
case. If sequence checking is not desired, the field 
may be blank and may consist of one blank column. 

Floating Variable x-^. Any number may be punched in this 

point (F) field. Decimal points are not required. 

The remaining fields on the card are reserved for 
variables. If there are more variables than can 
fit on the first card, a second and a third card may 
be used. 

Followli^ the data deck, the user must include a card containing a negative integer 
in the identification field. This card signals the end of data. 



3,4.. 
etc. 



,n 
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2.2.6 Matrix Input/Output 

It is possible to obtain punched card output of a number of matrices (see section 2.5.3) 
and vectors with this program. This program is designed to also input some of these 
matrices, at a later time, for further analysis or processing. In addition, matrices 
from another program or source, if punched in the program format, may also be used as 
input. 

This section is devoted to a description of various possible forms of analysis with the 
output options available in each program. 

Format Description 

See the matrix format given under "Format Description" in section 2. 1.4. 

Factor Analysis with Correlation Matrix Input 

The punched output option of the correlation matrix includes the punchout of the 
number of cases (matrix 21), and means and standard deviation vectors (matrix 23). 
This complete output can be used as input to initiate another analysis without the 
necessity of reprocessing the source data that was used to generate the matrices. 

To use the correlation matrix set as input, the user places the punched output behind 
the variable names card, followed by a blank card, or one that contains a negative 
number in the job number field. The program reads the number of cases, means, and 
standard deviations and correlation matrix, stores each in its appropriate location, and 
then initiates the analysis as specified on the option card. 

Pooling Sums of Squares and Cross Products (cc 35-36) 

The topic is discussed fully in section 2.1.4. When raw sums of squares matrices have 
been previously punched by this program (or by hand), in accordance with the above 
format description, they can be stacked and will be combined by using this option. 
When the option is given the number 0, they will be added. If a nonzero field is used, 
all matrices will be added until the first negative (left- justified) job number field 
(cc 1-4) is encountered. Subsequent matrices will be subtracted until the second 
negative problem number card is encountered. 

Iterating on Communalities * 

This program does not iterate on communalities, which is a desirable feature mentioned 
in section 2. 2. However, by electing to punch the correlation matrix, one can insert the 
estimated communalities on the diagonal of this matrix and iterate using matrix input. 



*The factor scores computation reads the original data matrix, X, from the disk. If 
X is not on the disk, which is the case if any card reader input with other data has 
been read subsequent to the reading of X, then X must be reread under input mode 1 
before this matrix input option is used. 
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2.2.7 Operating Instructions 

A. Using the factor analysis program when the total 1130 Statistical System has not 
been stored on the disk 

If the user wishes to load only the set of programs that allow this lype of analysis, the 
following programs must be compiled or assembled and stored on the disk. Each deck 
begins with a card punched as 

// FOR 

and ends with an 

♦STORE 

card. 

The user should use a disk containing the 1130 Disk Monitor System, as described in 
section 1. 1. The following decks should be preceded by a cold start card, placed in the 
card reader hopper, and the buttons IMMEDIATE STOP (console), RESET (console), 
START (card reader), and PROGRAM LOAD (console) should be pressed. A blank card 
should be placed after the last deck in the card reader hopper. 

DECKS- LABELS : FCTR-FCTR; FCTRl-FCTl; FCTR2-FCT2; 
FCTR3-FCT3; *FMTRD-FMRD; *DATRD-DTRD; *GMPYX-GMPY; 
*GDIVX-GDIV; *PRNTB-PRNB; **COREL-CORL; **PRNT~PRNT; 
**MXRAD-MXRD; INVRS-INVS; XMAX-XMAX; TRIDI-TRID; QR-QR; 
VECTR-VCTR; COVEC-CVEC; RFOUT-ROUT; PROMX-PRMX; 
VARMX-VRMX; RPRNT-RPNT; MATIN-MATN; SCORE-SCOR; 
♦FMAT-FMAT; TRAN-TRAN. 

In addition, regression and factor analysis programs must reside on the disk together; 
section 2.1.5 names additional routines to be placed on the disk. 

B. Execution from disk 

Once the component subroutines and main calling programs are on the disk, the 
execution of a job requires the monitor control cards, program control cards, and data 
cards to be placed in the card reader. The deck should be preceded by a cold start card. 
To initiate processing, the buttons IMMEDIATE STOP and RESET (console), START 
(card reader), and PROGRAM LOAD (console) should be pressed. The order in which 
the cards are placed in the card reader for either matrix or raw data input is shown in 
Figures 8, 9, and 10. 



*Used in all four analysis types 
**Used in regression analysis 
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Input/Output 
Units 

7L- 



Monitor 
Control 



Figure 8. Factor analysis card order — card reader Input 



/ 


/ 






'Optional 
Blank Out 


put 




/ 


Variable 
Names 






V 


('Option 








'job-Title 












flnput/Output 
Units 








/ 


/ 








Monitor 
Control 


/ 







Figure 9. Factor analysis card order — disk input 



Optional Blank 
■ Output 
'Negative 



Identification 



'Matrix 



'Matrix 



Variable 
Names 



('Option 
rOob-Title 
^l/O Units 



Monitor 
Control 



-(to be added to matrix 1) 



Figure 10. Factor analysis card order — matrix Input 
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2.2.8 Sample P roblem 



INPUT 

// XEQ FCTR 05 

*LOCALFCTR,FMTRD,OATRD,PRNTB.MXRADtTRAN 

*LOCALFCTRlf TRIOIf OR, INVRS 
♦LOCALCOREL.PRNT 
•L0CALFCTR2,VECTR,PRNT 
*L0CALFCTR3,VARHX,PR0MX, SCORE, RFOUT 

020200 

3333 FACTOR ANALYSIS SAMPLE PROBLEM 

0^0100000000000101010202020200020000 10101 010 10101010101010101 

PI P2 P3 P4 
I2I2,1X,4F6.0> 

0101 000063000075000159000041 
0201 0001010000920001'f20000'i-9 
0301 000119000098000131000068 
0401 000157000101000124000092 
0501 000178000104000119000097 
0601 0001470001060C0118000102 
0701 000128000108000116000109 
0801 000113000107000116000066 
0901 000094000107000115000044 
1001 000111000104000117000069 
1101 000139000110000104000117 
1201 0001570001070C0100000118 
1301 000169000111000075000157 
1401 000145000109000079000107 
1501 000079000095000096000069 
1601 000049000086000111000047 
1701 000048000077000111000032 
1801 000041000069000106000022 
1901 000066000062000097000017 
2001 00011100007400009200P045 
2101 000164Q00104000083000097 
2201 000170000117000039000164 
2301 000208000135000053000246 
2401 000237000148000058000366 
2501 000169000152000061000230 
2601 000114000137000073000175 
2 701 000106000130000077000178 
2801 000097000123000086000156 
2901 000099000110000092000125 
3001 000111000111000102000105 
3101 000068000108000108000081 
3201 000048000096000121000044 
3301 000042000078000123000020 
3401 000034000073000125000017 
3501 000048000084000125000014 



■1 



PUNCHED CORRELATION MATRIX OUTPUT 



3333 4 1 1 O.IOOOOOOE 01 0.7225732E 00-0.5793441E 00 0.7999757E 00 

3333 4 1 2 0.7225732E 00 O.IOOOOOOE 01-0.6567597E 00 0.8950214E 00 

3333 4 1 3-0.5798441E O0-0.6567597E 00 O.IOOOOOOE 01-0. 7525222E 00 

3333 4 14 0.7999757E 00 0.8950214E 00-0. 7525222E 00 O.IOOOOOOE 01 

333323 1 I 0.1122857E 03 0.5141101E 02 

333323 1 2 0. 1030857E 03 0.2161068E 02 

333323 I 3 0.1016e57E 03 0.2601331E 02 

333323 1 4 0.9960000E 02 0.7545321E 02 
333321 1 1 0.3500000E 02 
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PUNCHED FACTOR SCORES OUTPUT 



125 


0, 


. 195204 7E 


01- 


-0.2331642E 


01 


22 5 


0. 


.296384 7E 


00- 


-0.1594353E 


01 


32 5- 


-0, 


.4612540E 


00- 


-0.1131953E 


01 


42 5- 


-0. 


.2389709E 


01- 


-0,7728281E 


00 


52 5- 


-0, 


■3506941E 


01- 


-0.5253528E 


00 


62 5- 


-0. 


.1578879E 


01- 


-0.5796633E 


00 


725- 


-0, 


,3429788E 


00- 


-0.5622065E 


00 


825 


0. 


.6738971E- 


-02- 


-0.5635983E 


00 


92 5 


0. 


. 8490992E 


00- 


-0.5561192E 


00 


102 5 


0. 


.3999518E- 


-01- 


-0.6032414E 


00 


1125- 


-0, 


.1011253E 


01- 


-0.5632308E- 


-01 


1225- 


-0, 


.2248286E 


01 


0.1632854E 


00 


1325- 


-0, 


.2765937E 


01 


0.1167946E 


01 


1425- 


-0, 


. 1946555E 


01 


0.98R1128E 


00 


1525 


0. 


.1136240E 


01 


0.1907818E 


00 


1625 


0, 


.2493227E 


01- 


-0.4555233E 


00 


1725 


0. 


,1984453E 


01- 


-0.4183342E 


00 


1825 


0. 


.183794 8E 


01- 


-0.2014065E 


00 


1925- 


-0. 


.1365285E 


00 


0.2584075E 


00 


2025- 


-0. 


.1992324E 


01 


0.5247329E 


00 


2125- 


-0, 


,3228456E 


01 


0.6974963E 


00 


2225- 


-0. 


, 3100469E 


01 


0.2611022E 


01 


2325- 


-0. 


.3355663E 


01 


0.2021247E 


01 


242 5- 


-0. 


, 304406 2E 


01 


0.1755776e 


01 


252 5- 


-0, 


.3732885E 


00 


0.1551542E 


01 


2625 


0. 


,1751099E 


01 


0.10D5148E 


01 


2725 


0. 


2006 701E 


01 


0.8391422E 


00 


2 82 5 


0. 


2129229E 


01 


0.4382641E 


00 


2 92 5 


0. 


1194178E 


01 


0.3152475E 


OQ 


3025 


0. 


4921422E 


00- 


■0.4477804E- 


-01 


3125 


0. 


2693805E 


01- 


■0.3768844E 


00 


3225 


0. 


313544 5E 


01- 


•0.8926919E 


00 


3 32 5 


0. 


2451350E 


01- 


■0.9157080E 


00 


3425 


0. 


269484 8E 


01- 


■0.10C1286E 


01 


3525 


0. 


2337661E 


01- 


■0.9936304E 


00 








OUTPUT 
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// XEO FCTf! 



05 



•LOCALFCTRtF^ITRD.DATRDtPRNTBtMXRAD.TRAN 
•LOCALFCTRl.TRIDItQR.lNVRS 
•LOCALC09FL.PRNT 
•L0CALFCTR2.VECTR.PRNT 
»L0CALFCTR?tVAR'^XtOR0MX. SCORE tRFOUT 



FACTOR ANALYSIS SAMPLE PROBLEM 

NUMBER OF VARIABLES 

INPUT TYPE 
SEOUENCE CHECH 
VARIABLES ON CARD I 
VARIABLES ON CARD 2 
VARIABLES ON CARD 3 
TRANSFORMATION SWITCH 
OUTPUT RAW CROSS PRODUCTS 

OUTPUT RESIDUAL CROSS PRODUCTS 

OUTPUT VARIANCE - COVARIANCE 

OUTPUT CORRELATION 

FACTOR SCORES 

NUMBER OF FACTORS OPTION 

NUMBER OF FACTORS Oft PERCENT OF TRACE 

COMMONALITY OPTION 

ROTATION OPTION 

NUMBER OF FACTORS TO ROTATE 

POOLING OPTION 

LATENT VECTORS 

UNROTATED FACTOR MATRIX 

ORTHOfiONAL TRANSFORMATION MATRIX 

ORTHOGONAL FACTOR MATRIX 

TRANSFORMATION MATRIX TO OBLIQUE REFERENCE VECTOR STRUCTURE 

OBLIQUE REFERENCE VECTOR STRUCTURE MATRIX 
CORRELATIONS AMONG OBLIQUE REFERENCE VECTORS 
OBLIQUE REFERENCE VECTOR PATTERN MATRIX 

CORRELATIONS BETWEEN REFERENCE VECTORS AND PRIMARY FACTORS 

OBLIOUE PRIMARY FAi-TQR STRUCTURE MATRIX 
CORRELATIONS AMONG OBLIQUE PRIMARY FACTORS 
OBLIQUE PRIMARY FACTOR PATTERN MATRIX 
FACTOR SCORE REGRESSION COEFFICIENTS 



JOB 3333 



PAGE 



12I2flXf4F6.0) 



FACTOR ANALYSIS SAM-.E PROBLEM 



MATRIX OF RAW CROSS-PRODUCTS 



VARIABLE 
PI 
P2 
P3 

P<> 



PI 
0.S3114E 06 
0<*32«2E 06 
0.3732SE 06 



P2 
a.43242E 06 
0.3BTelE 06 
0.3S432E 06 



P3 

0.37325E 06 
0.39432E 06 
0<3e490E 06 



P4 
0.49693E 06 
0.40e97E 06 
0>3O423E 06 



0.49693E 06 0.«0e97E 06 0.3042SE 06 0.S407TE 06 
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FACTOR ANALYSIS SAMPLE PROBLE'f 



MATRIX OF RESIDUAL CROSS-PRODUCTS 



VARIABLE 
PI 

02 
P3 
P4 



PI 
0.89865E 05 



P? 
0.27295E 06 



P3 
-0.26355E 05 



0.10550E 06 



0.27295F 05 0.1597aE 05 -0.125'i3E 05 0.49620E 05 

-0.26365E 05 -0.12553E 05 0.23007E 05 -0.50219E 05 

O.lnSSOE 06 0.»962'1E 05 -0.50219E 05 0.19356E 06 



FACTOR ANALYSIS SAWPLE PROBLEM 



PAGE 



VARIANCE - COVARIANCE MATRIX 



VARIABLE 
PI 

P? 
P3 

P4 



PI P2 

0.2643oe 04 0.B0279E 03 



P3 P4 

•0.77546E 03 0.31032E 04 



0.«0?7PE 03 0.46702E 03 -O.369J0E 03 0.14594E 04 

-0.77546E 03 -0.36920E 03 0,57669E 03 -0.14770E 04 

0.3103?F 04 0.14594F 04 -0.14770E 04 0.56931E 04 



FACTOR ANALYSIS SAMPLE PROBLEM 



SUMMARY STATISTICS 
VARlAflLE 



NO. OF CASES" 35 

LOW HIGH 



STO. DEV> 



VARIANCE 



1 P-1 

2 P2 

3 P3 

4 P4 



0.34000E 02 
0.62000E 02 
0.39000e 02 
0.14000E- 02 



0,2370OE 03 

0,15200E 03 

0<15900E 03 

0.36600E 03 



0.U228E 03 
0,10308E 03 
Otl0l68E 03 
0.99600E 02 



O.5I4IIE 02 
0.21610E 02 
0«26013E 02 
0<754S3E 02 



0.26430E 04 

0.46702E 03 

0«67669E 03 

0.56931E 04 



FACTOR ANALYSIS SAMPLE PROBLEM 



3333 



MATRIX OF CORRELATION COEFFICIENTS 



P4 



PI 
R2 
P3 
P4 



O.IOOOOE 01 
0,7??57E 00 



.72257E 00 -0.579fi4E 00 
.lOnnoE 01 -n.6567SE 00 



-0.>S79S4E 00 -0.65675E 00 O.lOOOOE 01 
0.79997E 00 0.89602E 00 -n.75252E 00 



0.79997E 00 
P.B9502E 00 
•0.75252E 00 

O.lOOOOE 01 
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FACT09 ANALYSIS SAMPLE PROBLE" 



PI 


-0.4l)1llE 


00 


-0,54530E 


00 


02 


-0.S1J66E 


00 


-0.l6fi69E 


00 


P3 


0.461flRE 


00 


-0.81965E 


00 


P^i 


-0.53e92f 


00 


-0.55nfl2E- 


■01 



J08 



MATRIX OF CHARACTERISTIC VECTORS 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOB 3333 



PACE 



TRACE *,0000 
CHARACTERISTIC ROOTS 



CUMUL. PERCENT OF TRACE 



3.2134 
0.4301 
0.27S3 
0.0810 



80.3374 

91.0900 

0.0000 

0.0000 



FACTOR ANALYSIS SAMPLE PROBLEM 



PI -0.d6604E 00 -0,35762E no 

P2 -n. 919016 00 -0.ln931E 00 

P3 0.fl279BE 00 -0.51754E 00 

P4 -0.96608E 00 -0.36124E-01 

CnwMUNALITIFS 

0.S779364E 00 
0.8'i65298E 00 



NORMALIZED UNROTATED FACTOR LOADINGS 



0.9745132E 00 
0.934622')E 00 



FACTOR ANALYSIS SAMPLE PROBLEM 



NORMAL VARIVAX CRITERION (NORMALIZED! 
CRITFRION DIFFERFNCE EPSILON CRITERION" 



a.02<!90188 
0.18610206 
0.18610206 



0. 00116000 



0.02fi50189 
0.15760016 

o.oooonooo 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOS 3333 



ORTHOGONAL TRANSFORMATION MATRIX 



VARIA'^LE 


1 


2 


1 


0.7966 


-0.6044 


2 


0.6044 


0.7966 
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FACTOR ANALYSIS SAMPLE PROBLEM 



VARIABLE 



ORTHOflONAL FACTOR MATRIX (VARIMAX 1 



PI 
P2 

P3 
P4 



-0.9061 


0.2385 


-0.7982 


0.4684 


0.3346 


-0.9287 


-0,7914 


0.S551 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOS 



TRANSFORMATION TO OBLIQUE REFERENCE VECTOR STRCTR. 



VARIABLE 


1 


2 


1 


0.9322 


0.3853 


2 


0.3617 


0.9227 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOB 
CORRELATIONS AMONG OBLIQUE REFERENCE VECTORS 



13 



VABIA>5L€ 


1 


2 


1 


1,0000 


0.6931 


2 


0.6931 


1.0000 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOB 



14 



OBLIQUE REFERENCE VECTOR STRUCTURE MATRIX 



VARIABLE 


1 


2 


PI 


-0.7584 


-0,1290 


P2 
P3 
P4 


-0.5746 
-0.0239 
-0.S370 


0,1246 

-0.7279 

0.2072 



FACTOR ANALYSIS SAMPLE PROBLEM 



OBLIQUE REFERENCE VECTOR PATTERN MATRIX 



VARIABLE 


1 


2 


PI 


-1,287* 


0.7632 


P2 


-1,2722 


1.0063 


PS 


0.9249 


-1.3690 


P4 


-1.3099 


l.llSl 
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FACTOR ANALYSIS SAMPLE PROBLEM 



VARIABLE 


1 


2 


1 


0.720S 


0,0000 


2 


0.0000 


0.7208 



J08 3333 

CORR. BET. REFERENCE VECTORS AND PRIMARY FACTORS 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOB 3333 



VARIABLE 


1 


2 


1 


1.0000 


-0.6931 


2 


-0.6931 


1.0000 



CORR. AMONG OBLIQUE PRIMARY FACTORS 



FACTOR ANALYSIS SAMPLE PROBLEM 



OBLIQUE PRIMARY FACTOR STRUCTURE MATRIX 



VARIABLE 
PI 


1 
-0.92B0 


2 

0.5502 


P2 


-0.9170 


0.725* 


P3 


0.6667 


-0.9860 


P* 


-0.9**2 


0.8038 



FACTOR ANALYSIS SAMPLE PROBLEM 



OBLIQUE PRIMARY FACTOR LOADINGS 



VARIABLE 


1 


2 


PI 


-1.0521 


-0.1790 


P2 


-0.7972 


0.1728 


P3 


-0.0332 


-1.0098 


P* 


-0.7450 


0.2875 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOB 3333 



PAGE 



FACTOR SCORE REGRESSION COEFFICIENTS 



ABLE 


1 


2 


PI 


-2.9865 


0.1*0* 


P2 


0.961* 


-0.0652 


PS 


0.**8T 


-1.0582 


P* 


0.83T3 


-0.06*1 
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FACTOR ANALYSIS SAMPLE PROBLEM 



JOS 3333 



PAGE 



21 









FACTOR SCORES 


IDENTIFI 


ICATION 


1 


2 


1 


1 


0.19520E 01 


-0.23316E 01 


2 


2 


0.2963flE 00 


-0.1S943E 01 


3 


3 


-0.4612SE 00 


-0.11319E 01 


1, 


4 


-0.23897e 01 


-0.77282E 00 


i 


5 


-0.35069E 01 


-0.52535E 00 


t 


6 


-0.15788E 01 


-0.57966E 00 


7 


7 


-0.34297E 00 


-0.56220E 00 


8 


8 


0.67389E-02 


-0.56359E 00 


9 


t 


O.X4909E 00 


-0.55611E 00 


10 


10 


0.39995E-01 


-0.60J24E 00 


11 


11 


-0.101126 01 


-0.56823E-01 


12 


12 


-0.22482E 01 


0.16328E 00 


13 


13 


-0.27659E 01 


0.1167eE 01 


14 


14 


-e.l9465E 01 


0.988HE 00 


15 


IS 


0.11362E 01 


0.19078E 00 


16 


16 


0.24932E 01 


-0.45*52E 00 


17 


17 


0.19B44E 01 


-0.418i33E 00 


18 


18 


0.18379E 01 


-0.20140E 00 


H 


19 


-0.13652E 00 


0.25840E 00 


20 


20 


-0.19923E 01 


0.S2473E 00 


21 


21 


-0.32284e 01 


0.69749E 00 


22 


22 


-0.31004E 01 


0.26110E 01 


23 


23 


-0.33556E 01 


0.20212E 01 


24 


24 


-0.30440E 01 


0.17557E 01 


25 


25 


-0.3T32aE 00 


0.15615E 01 


2i 


26 


0.17S10E 01 


O.IOOSIE 01 


27 


27 


0.20067E 01 


0.83914E 00 


2B 


28 


0.21292E 01 


0.48826E 00 


29 


29 


0.11941E 01 


0.31S24E 00 


30 


30 


0.492146 00 


-0.44778E-01 


31 


31 


0.26938E 01 


-0.376l«8E 00 


32 


32 


0.31354E 01 


-0.89249E 00 


33 


33 


0.24S13E 01 


-0.91570E 00 


34 


34 


0.26948E 01 


-0.10012E 01 


35 


35 


0.23376E 01 


-0.99368E 00 


JOB COMPLETEO 







CORRELATION MATRIX INPUT — MULTIPLE R**2 ON DIAGONAL 



// XEQ FCTR 05 

*LOCALFCTR,FHTRD,0ATR0f PRNTB.MXRADf TRAN 
♦LOCALFCTRl.TRIOIfORflNVRS 
♦LOCALCOREL.PRNT 
*L0CALFCTR2,VECTR,PRNT 
♦L0CALFCTR3 , VARMX , PROHX , SCORE , RFOUT 
020200 

3333 FACTOR ANALYSIS SAMPLE PROBLEM 

040300000000000000000100020200020000 10 1000 10 101 01000 1010 10 100 
PI P2 P3 P4 

0.5412571E 00 0.7225732E 00-0.5798441E 00 



3333 4 I 
3333 4 1 
3333 4 1 
3333 4 1 
333323 1 
3 33323 1 
333323 I 
333323 1 
333321 I 
-1 



0. 
00 0. 



7999757E 
8950214E 



00 

00 



2 0.7225732E 00 0.8018028E 00-0.6567597E 

3-0.579844IE 00-0.6567597E 00 0.5689992E 00-0.7525222E 00 

4 

1 

2 

3 

4 

1 



0.7999757E 00 0.8950214E 00-0.7525222E 00 0.8816457E 00 
0.1122857E 03 0.514H01E 02 



1030857E 03 0.2161068E 02 
1016857E 03 0. 2601331E 02 



0.9960000E 02 0.7545321E 02 
0.3500000E 02 



OUTPUT 
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// XEQ FCTR 



05 



• LOCALFCTR»FMTROfDATRD.Pt?NTBtMXRAO»TrJAN 

»LOCALFCTR1.TRIDI.OR.INVRS 

»LOCALCOREL.PRNT 

»L0CALFCTR2»VECTRtPRNT 

»LOCALPCTR3.VARMXtPROMX.SC0RFtRF0UT 



FACTOR ANALYSIS SAMPLE PROBLEM 

Nu^flER OF VARIABLES 

INPUT TYPE 

SEnuENCE CHECK 

VARIABLES ON CARD 1 

VARIABLES ON CARD ? 

VARIABLES ON CARD 3 

TRANSFORMATION SWITCH 

OUTPUT RAW CROSS PRODUCTS 

OUTPUT RESIDUAL CROSS PRODUCTS 

OUTPUT VARIANCE - COVARIANCE 

OUTPUT CORRELATION 

FACTOR SCORES 

NU^'RER OF FACTORS OPTION 

VU'iBER OF FACTORS OR PERCENT OF TRACE 

CO'^yuNALITY OPTION 

ROTATION OPTION 

NUMBER OF FACTORS TO ROTATE 

POOLING OPTION 

LATENT VECTORS 

UNROTATED FACTOR MATRIX 

ORTHOGONAL TRANSFORMATION MATRIX 

ORTHOGONAL FACTOR MATRIX 

TRANSFORMATION MATRIX TO OBLIQUE REFERENCE VECTOR STRUCTURE 

OBLIOUF REFERFNCF VECTOR STRUCTURE MATRIX 

CORRELATIONS AWQNS OBLIQUE REFERENCE VECTORS 

OBLIQUE REFERENCE VECTOR PATTERN MATRIX 

CORRELATIONS BETWEEN REFERENCE VECTORS AND PRIMARY FACTORS 

OBLIOUE PRIMARY FACTOR STRUCTURE MATRIX 

CORRELATIONS AMONG OBLIQUE PRIMARY FACTORS 
OBLIQUE PRIMARY FACTOR PATTERN MATRIX 
FACTOR SCORE REGRESSION COEFFICIENTS 



FACTOR ANALYSIS SAMPLE PROBLEM 



PI 


-0.4S72HE 


00 


-0.A7333E 


00 


P2 


-0.52362E 


00 


-0.31961E 


00 


P3 


0.43S27E 


00 


-0.81887E 


00 


B<t 


-0. 563916 


00 


O.S6930E- 


■01 



MATRIX OF CHARACTERISTIC VECTORS 



FACTOR ANALYSIS SA''CLE dROBLE" 



TRACE 2.0937 

CHARACTERISTIC ROOTS 



CUMUL. PERCENT OF TRACE 



102.1609 



0.0296 
-0.0061 
-0.CB64 



103.1991 
0.0000 
0.0000 
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FACT09 ANALYSIS SAMPLE PRORLE" 



JOB 3333 PAGE 3 



NORMALIZED UNROTATED FACTOR LOADINGS 



PI -0.flO'»46E on -0.B1735E-O1 

°? -0.<in033E no -0.55183E-01 

P^ 0.74fl42E on -0.14138E no 

P4 -0.96961E 00 0.98294E-02 

COWMUNALITIFS 

0.6522407F 00 

0.nl36515E 00 

0.5«01334E 00 

n.O40?')21E 00 



F»CTOR ANALYSIS SAMPLE PROBLEM 



JOB 3333 PAGE 4 



NORMAL VARIMAX CRITERION (NORMALIZED) 

EPSILON CRITERION" 



CYCLE 

1 


CRITERION 
0.0Q03S874 


DIFFERENCE 
0.00035874 


2 


0.02373140 


0.02337265 


3 


0.023731*0 


o.oooooono 



0.00116000 



FACTOR ANALlfSlS SAMPLE PROBLEM 



JOB 3333 PAGE 5 



ORTHOGONAL FACTOR MATR IX (VARIMAX ) 



VARIABLE 
PI 


1 
-0.6504 


2 

0.4786 


P2 


-0.7044 


0,5633 


P3 
P4 


0.4599 
-0.7121 


-0.6071 
0.6580 



FACTOR ANALYSIS SAMPLE PROBLEM 



JOB 3333 
TRANSFORMATION TO OBLIQUE REFERENCE VECTOR STRCTR. 



VARIABLE 


1 


2 


1 


0.8730 


0.3683 


2 


0.4876 


0.9296 



FACTOR ANALYSIS SAMPLE PROBLEM 



VARIABLE 


1 


2 


1 


1,0000 


0.7749 


2 


0.7749 


1,0000 



JOB 3333 

CORRELATIONS AMONG OBLIQUE REFERENCE VECTORS 
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FACTOR ANALYSIS SAMPLE PROBLEM 



JOS 3333 



VARIABLE 
PI 
02 

03 
04 



1 
-0.3344 
-0.3403 

0.1054 
-0.30ns 



2 
0.2054 
0.264? 

-0.3950 
n.3494 



OBLIQUE REFEI^ENCE VECTOR STRUCTURE MATRIX 



FACTOR ANALYSIS SAVfoLE PROBLEM 



JOB 3333 

CORK. BET. REFERENCE VECTORS AND PRIMARY FACTORS 



VApIABLF 


1 


2 


1 


0.6320 


0.0000 


2 


0.0000 


0.6320 



FACTOR ANALYSIS SAMPLE PROBLEM 



VARIABLE 


1 


2 


1 


1.0000 


-n.7749 


2 


-0.7749 


1.0000 



CORR. AMONG OBLIQUE PRIMARY FACTORS 



FACTOR ANALYSIS SAMPLE PROBLEM 



VARIABLE 


1 


2 


01 


-0.7810 


0.7351 


02 


-0.8624 


0.B353 


P3 
P4 


0.6512 
-0.9045 


-0.7543 
0.9219 



OBLIQUE PRIMARY FACTOR STRUCTURE MATRIX 



FACTOR ANALYSIS SAMPLE PROBLEM 



12 



VARIABLE 
PI 


1 
-0.5291 


2 

0.3260 


P2 


-0.5394 


0.4181 


P3 


0.1668 


-0.6250 


04 


-0.4760 


□.5329 



JOB COMDLETEO 



OBLIQUE PRIMARY FACTOR LOADINGS 
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2.3 ANALYSIS OF VARIANCE 

From the experimental observations on a variable x, this program will compute an 
analysis of variance for a complete factorial design for a maximum of four (4) factors. 
The method used in the program is essentially that described by H.O. Hartley. * This 
method is particularly useful, since it can be extended to accommodate a great many 
experimental designs. 

The extension to other experimental designs is accomplished by a very simple 
procedure. The program performs a factorial analysis and then allows the user to pool 
certain components of the analysis of variance table in accordance with the summary 
instructions that specifically apply to the particular design desired. For example, a 
two- or three-factor design can result in the following analysis of variance tables: 

• Sit^le classification 

• Two-way classification with cell repetition 

• Randomized block with two factor treatments 

• Split plot 

• Split-split plot 

• Three-factor randomized blocks 

By utilizing a special report generator, the user has flexibility in choosing the 
appropriate components to pool in forming the error term or terms to accommodate 
the above designs or any other similar designs. 

Once the data is contained in storage, the sum of squares is computed as follows: 

Let A. = Sum of all the observations at level a 

1 1 

n = Number of observations summed to obtain A. 
a 1 

AB = Sum of all observations at level ab.. 
ij y 

n , = Number of observations summed to obtain AB.. 
ab I] 

ABC , = Sum of all observations at level abc, 
i]k i]K 

n , = Number of observations summed to obtain ABC... 
abc iJK 

Thus, a general formula for the main effect due to factor A is: 

SS = -— - — 

a n^ Hg 

*Ralston, A. and Wilf, H. S. , Mathematical Methods for Digital Computers . New York: 
John Wiley and Sons, Inc., 1960, pp. 221-230. 
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where G = the grand total of all observations, and ng Is the number of observations 
summed to obtain G. The main effect due to factor B has the form: 



b 



^^ i G^ 



\ 



The general computational formula for the variation due to the AB interaction Is: 



SS , = 



ab n 



2(AB ) 2 

U H (SS + SS. ) 

n a b' 

g 



ab 



The general computational formula for the variation due to the ABC interaction is: 



SS 



abc 



Il^fSiiL-G! 



abc 



g 



(SS + SS^ + SS + SS ^ + SS + SS^ ) 
a b c ab ac be 



The following table shows the layout of the complete table for the analysis of variance 
of a complete factorial design: 

ANOVA TABLE FOR A COMPLETE FACTORIAL DESIGN 







Sum of 




Source of Vjariation 


D.F. 


Squares 


Mean Square 


A Main effect 


(p-1) 


SSa 


SSa/ (P-1) 


B Main effect 


(q-1) 


SSb 


SSb/ (q-1) 


C Main effect 


(r~l) 


SSc 


SSc/ (r-1) 


AB Interaction 


(P-I)(q-1) 


SSab 


SSab/ (p-i)(q-i) 


AC Interaction 


(p-l)(r-l) 


SSac 


SSac/ (P-l)(r-l) 


BC Interaction 


(q-l)(r-l) 


SSbc 


SSbc/ (q-i)(r-i) 


ABC Interaction 


(p-l)(q-l)(r-l) 


SSabc 


SSabc/ (p-l)(q-l)(r-l) 


Experimental error 


pqr (n-1) 


^^error 


SSerror/ Pqr (n-1) 


(within cell) 








Total 


npqr-1 


SSfnfnt 





where p = number of levels in factor A 
q = number of levels in factor B 
r = number of levels in factor C 
n = number of observations per cell 

To obtain other experimental designs from a complete factorial design, the user should 
analyze the data as if it were a complete factorial design, and then reconstruct his 
ANOVA table from the output. 

Not all experimental designs can be handled by this technique, notably Latin and Youden 
squares, lattices, and incomplete randomized blocks. 



73 



Also, this program does not handle repeated measurement designs (that is, replications 
must be considered as a factor). For a detailed account of the various ejqperimental 
designs, see O. Kempthorne, Design and Analysis of Experiments (John Wiley, 1952). 

Single Classification Design (A X B). In this case, the replications are considered as a 
factor (B). The error term is: 

SSerror ~ ^^h "^ ^^ab 

giving the following reconstructed ANOVA table: 

SSa 
SSerror 



SStotal 

Two-Way Classification with Cell Repetition (A X B X C) . This differs from a random- 
ized block design in that one is not interested in the recovery of interblock information. 
Consequently, the error term is: 

ss = ss + ss + ss. + ss , 

error c ac be abc 

(where factor C is the cell repetitions) thus giving the following ANOVA table: 

SSa 
SSb 

SSab 
S^error 

SStotal 

Randomized Block with Two Treatment Factors (A X B X C) . Here the third "factor" 
(C) is blocks. In this case, one is interested in finding out whether there are significant 
differences between blocks, so the error term is computed from: 

SS = SS + SS, + SS , 

error ac be abc 



thus giving an ANOVA table as follows: 



SSa 

SSb 

SSab 

SSp (blocks) 

SSerror 
^^total 
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Split-Plot Design (A X B X C). In this case, let factor A = main treatments; B = sub- 
treatments, and C = blocks. Then, appropriate error terms are calculated as follows: 



(a) SS = SS 

error ac 

(b) SS = SS^ + SS ^ 

error be abc 



The ANOVA table becomes 


i: 


Main treatment 




A 


Blocks 




C 


Error (a) 






Subtreatment 




B 


Interaction 




AXB 


Error 






Total 






Split-Split Plot Design (A X B X C X D). The 




A = 


Main treatment 




B = 


Subtreatment 




C = 


Sub-subtreatment 




D = 


Blocks 



SS 



SS 



SS 



ac 



SS. 



SS 



ab 

SS, + SS ^ 
be abc 



SS 



total 



Consequently, there will be three separate error terms: 

(a) SS = SS 

error ac 

(b) SS = SS. + SS ^ 

error be abc 

(c) SS = SS . + SS^ ^ + SS , + SS , , 
' error dc deb dca dcab 

This gives the following reconstructed ANOVA table: 



A 
C 



SS 
a 

SS 



Error (a) SS 



ac 



B 



SS, 
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A X B SS , 

ab 

Error (b) SS^^ + SS^^^ 

SS^ 

A X D SS , 

ad 

B X D SS, , 
bd 

AXBXD SS ^^ 
abd 



Error (c)SS^^-HSS^^^^-^SS^^^^SS^^^^^ 

^^'^^ ^^total 

Three-Factor Randomized Blocks (A X B X C X D) . Let factor C = blocks. 
The error term becomes: 

SS = SS + ss^ + SS, + SS , + ss_ - + ss + SS 

error ac be dc abc acd bed abcU 
Thus giving the following reconstructed ANOVA table: 



A 


^\ 


B 


««b 


D 


S^d 


C (blocks) 


SS 
c 


A XB 


SS , 
ab 


A XD 


S^ad 


B XD 


«^bd 


AXBXD 


SS , , 
abd 


Error 


SS + SS, + SS , + ss 

ac be dc ac 


Total 


^^total 



+ ss^ , + ss . + ss 

bed abc abed 



2.3.1 Tests of Significance 

The output of this program consists of the sums of squares and mean squares for all 
the main effects and interactions, together with the error mean square. In general, 
these main effects and interactions are tested for significance by dividing the mean 
square for the particular effect or interaction by the appropriate error term. The 
difficulty arises in the choice of the appropriate error term. A brief account of how 
to choose the correct error term is given below. This account is by no means com- 
prehensive, and if the user is in any doubt as to the error term to use in his own case, 
he should consult H. Scheffe, The Analysis of Variance, John Wiley, 1959 . 
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The basis for the choice of error term in ANOVA F-tests is the type of structural model 
used for the analysis of variance. Three models are discussed below; these should 
cover the majority of cases. 

1. Model I (Fixed Effects) . The fixed effects model is applicable when the factors used 
in the experiment include all possible levels for each factor, and when inferences 
are not made about any levels not included. Examples of this are such factors as 
sex, where there are only two levels possible; or training methods for teachli^ a 
specific skill; or, in a drug experiment, the treatments factor, where one is inter- 
ested in the drugs used, and would not obviously want to malie inferences to other 
drugs not included in the experiment. In the case of a fixed factor, the investigator 
is interested only in the levels of the variable studied in the experiment and not in 
any others. In this case, the computation of the F-ratio is relatively simple. The 
F-ratios are calculated using the error term as a divisor (for example, M^a^MS^^ror 
for the A main effect; MS /MS : AB interaction, etc.). 

2. Model II (Kandom Effects) . The random effects model applies when the experiment 
involves only a random sample of the set of treatments about which the experimenter 
wants to make inferences. For example, to study the effects of a certain drug (say 
alcohol) on driving skill, one would have several different levels (doses) of alcohol 
within the drug factor. However, all possible levels of alcohol could not be used, so 
one takes what is considered to be a random sample of the levels within the factor 
and then makes inferences about other levels. 

Another example would be the following: 

To study the effects of level of illumination on productivity in a factory, the luminance 
factor would be a random effects factor, since all possible levels of luminance would 
not be used in the experiment, but only a sample of them. 

An analysis of variance with all random effects is rarely found, and the calculation 
of F-ratios for this case presents some difficulties. For a two-factor model (A X B), 
the F-i-atios are: 

A: MS /MS ^ 
a ab 



B: MS^/MS 



ab 



AB: MS ,_/MS 

ab error 

For the three-factor case (A X B X C), we have the following F-ratios: 

A: (MS^ + MS^^^)/(MS^^ + MS^^) 

B: (MS^ + MS^^^)/(MS^j^ -H MS^^^) 

C: (MS^ + MS^j^^)/(MS^^ -H MS^^) 
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AB: MS ^/MS . 
ab abc 

AC : MS /MS ^ 
ac abc 

BC: MS^ /MS ^ 
be abc 

ABC: MS , /MS 

abc error 

In the case of the random effects model, the interactions should be tested for 
significance first, because if they are found to be significant, there is little point 
in testing the main effects for significance. 

3. Model m (Mixed Model) . The mixed model is probably the most common form used 
in analysis of variance. Here some factors are fixed, and others are random. 

The calculation of the F-ratios in this case depends on which factors are fixed and 
which are random. An example is given with two fixed factors and one random 
factor. 

A X B X C Design with Factor A a random effect: 

*A: MS /MS 

a error 

B: MS^/MS ^ 
b ab 

C: MS /MS 

c ac 

*AB: MS ^/MS 

ab error 

*AC: MS /MS 

ac error 

BC: MS^ /MS ^ 
be abc 

ABC: MS ^ /MS 

abc error 

2 ,. 3 . 2 Job Execution 

To perform an analysis of variance, the user must supply four sets of cards to the 
program: 

1. Monitor control cards 

2. Program control cards 

3. Data cards 

4. Table output specification cards 



♦Random effects 
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Monitor Control Cards 

The monitor control cards are necessary to initiate program loading from the disk and 
to establish the necessary communication with the monitor. A general description of 
the cards may be found in IBM 1130 Disk Monitor System Reference Manual (C 26-3750). 

An analysis of variance requires the following cards: 

CC: 14 8 16-17 

// XEQ ANOVA 02 

*LOCALANOVA, FMTRD, PRNTB, DATRD, STORE 

*LOCALANOV2, SDOP, MNSQ, REPRT 

The monitor control cards do not change from job to job, but must be included with every 
job processed. 

Program Control Cards 

The program control cards communicate the data-specific parameters and output options 
to the program. The five card types are described below. In addition, control cards are 
necessary for defining the format and content of the ANOVA table (section 2.3.3). 

1. Input/output units card* 

2. Job-title card* 

3. Option card (described below) 

4. Variable format card* 

5. Table generation card (section 2. 3. 3) 
Option Card 

Number of Factors (cc 1-2) 

This field is punched with an integer, n, less than or equal to 4; n is the total number 
of factors in the experiment. 

Input Mode (cc 3-4) 

This field must be punched with an integer, n, which may take the values 1 or 2. If n is 
equal to 1, the program reads the raw data from the 1442 card reader. If n = 2, the raw 
data is read from the disk, where it has previously been transferred by a program using 
input mode number one. The data is retained until destroyed by input (mode 1) from one 
of the four system programs. 



*See "General Operating Instructions", Chapter 1. 
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Transformation Switch (cc 5-6) 

K the value in this field is equal to zero, the transformation program is not used. If 
the value is 1, the transformation program is called after each data item has been read, 
and before the item is stored in the appropriate storage cell. The transformation 
program itself is a user-written FORTRAN program, which is discussed in section 2.5.1. 

Number of Levels for Factor 1 (cc 7-8) 

This field must be punched with an integer, n, which indicates the number of levels in 
the first factor. For example, n would be equal to three for a 3X4X5 factorial design; 
n should be less than ten. 

Number of Levels for Factor 2 (cc 9-10) 

Same as cc 7-8. This field is for factor 2. 

N umber of Levels for Factor 3 (cc 11-12) 

Same as cc 7-8. This field is for factor 3. 

N umber of Levels for Factor 4 (cc 13-14) 

Same as cc 7-8. This field is for factor 4. 

Columns 11-12 and 13-14 may be left blank for a two-factorial experiment. However, 
the program does not operate for fewer than two factors. All four factors, whether used 
or not, must be accounted for on the variable format card. The product of the levels of 
the factors is limited to 2000. 

Analysis of Variance Option Card Summary 

Column Meaning 

1-2 Number of factors 

3-4 Input Mode 

1 - Source data from card reader 
*2 - Source data from disk 

5-6 Transformation Switch 

- No transformation 

1 - Transformation 

7-8 Number of levels for factor 1 

9-10 Number of levels for factor 2 

11-12 Number of levels for factor 3 

13-14 Number of levels for factor 4 



*Data previously entered under mode 1 is available for mode 2 until destroyed by input 
(mode 1) from this or one other of the system's four main programs. 
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2.3.3 Analysis of Variance Tab le Generation 

The operation of the program is designed to handle a general four-factorial design. The 
program will read the data, form the deviates, and accumulate the sums of squares as 
if all four factors were always present. As a result of this operation, certain accumu- 
lation and storage areas, in general, have cells that are not used unless all four factors 
are present. In forming the analysis of variance table for a particular design, the user 
has the option of pooling component sums of squares to form the error sums of squares 
specific to the design. The sums of squares are located in storage and can be accessed 
by the table generator cards. The table, components, and index are shown below: 



Subscript 


Component 


1 


A 


2 


B 


3 


C 


4 


D 


5 


AB 


6 


AC 


7 


AD 


8 


BC 


9 


BD 


10 


CD 


11 


ABC 


12 


ABD 


13 


ACD 


14 


BCD 



15 ABCD 

For a two-factor experiment, the sums of squares are located in cells with subscripts 

1,2,5 
For a three-factor experiment, the sums of squares are located in cells with subscripts 

1,2,3,5,6,8,11 
For a four-factor experiment, the sums of squares are located in cells with subscripts 

1,2. ..,15 

Table Generator Card Format 

To print the proper component and compute the appropriate error term for a particular 
design, a set of table cards indicating the appropriate terms must be punched. A 
description of this card is given below: 

Column Meaning 

1"16 Row heading for component. This field may contain any 16 or 

fewer characters that serve to identify the row of the table. 
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Column Meaning 

17-20 Print and end control. 

or blank - Normal card. 
+1 - Skip to a new page and print column headings and title 

information before printing line for this component. 
-1 - Last card. No more component cards will follow. The 

analysis will be complete after this card is processed. 

The residual and total line will be printed. 

21-22 Subscript of the correspondence table component, to be printed 

or used in accumulation of the sums of squares. For example, 
if this field contains a 5, the component AB will be used for 
either printing (the remainder of the card is blank) or accumulation. 

23-24 Subscript of the cell in the correspondence table to be added to the 

cell used in cc 21-22. This procedure is used for adding components 
to form the sums of squares. For example, if cc 21-22 contained a 
1 and cc 23-24 contained a 4, the printed sums of squares, mean 
square, and degrees of freedom would be A + AB. 

25-26 The remaining two-digit fields have the same effect as cc 23-24, 

27-28 but are used to add additional components before printing the line. 

For example, if cc 21-22 contained a 2, cc 23-24 contained a 6, 
and cc 25-26 contained a 9, the sums of squares, mean square, 
and degrees of freedom would be printed as the cumulative summary 
49-50 of B + AC + BD. 

Table Generator Card Summary 

Column Meaning 

1-16 Alphameric heading for analysis of variance component. 

17-20 END of table Indicator 

- More cards to follow 

-1 - No more cards to follow 

1 - Skip to a new page before line is printed 

21-22 Table component to be printed 

23-24 Table component to be pooled 

N - Add the component with subscript N (corres. table) to the 
first component defined in cc 21-22. 

25-26 Same as cc 23-24 

27-28 Same as cc 23-24 
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Column Meaning 

29-30 Same as cc 23-24 

31-32 Same as cc 23-24 

33-34 Same as cc 23-24 

35-36 Same as cc 23-24 

37-38 Same as cc 23-24 

39-40 Same as cc 23-24 

41-42 Same as cc 23-24 

43-44 Same as cc 23-24 

45-46 Same as cc 23-24 

47-48 Same as cc 23-24 

49-50 Same as cc 23-24 
2.3.4 Data Input 

To set up the data for the analysis of variance, the user must identify each item of data 
as to its factor and level, and punch this information on a card along with the data item. 
Hence, each data card will have five fields, as follows: 

^^^Id Type Meaning 

1 Integer (I) Number of level - factor 1 

2 Integer (I) Number of level - factor 2 

3 Integer (I) Number of level - factor 3 

4 Integer (I) Number of level - factor 4 

5 Floating point (F) Observation 

Disk working storage allows input of 499 observations. 

The particular columns occupied by each field are arbitrary. The user describes the 
format of the card by means of a variable format card, which is entered into the program 
behind the option card. On the format card, provision must be made for all four "level" 
fields, even though all four fields are not necessary In the particular analysis. Figure 11 
shows a sample data card from a two-factor design. 
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Data card 



CC: 1 2 3 4 5 6 7 11-12 

r 



2 4 32 



CC: 1 



Format card (^(212, 211, F6.0) 



Figure 11. Sample cards from two-factorial design 



In normal usage, the data items are punched one to a card, with the appropriate 
identification. Following the data deck, there must be an end-of-deck indicator card, 
which is a card containing a negative number in the first field. The order of cards is 
arbitrary, as the cards are rearranged in proper order before the analysis takes place. 

2.3.5 Operating Instructions 

A. Using the analysis of variance program when the total 1130 Statistical System has 
not been stored on the disk 

If the user wishes to load only the set of programs that allow analyses of variance, 
the following programs must be compiled or assembled and stored on the disk. Each 
deck begins with a card punched as 

//FOR 

and ends with an 

♦STORE 

card. 

The user should use a disk containing the 1130 Disk Monitor System, as described 
in section 1. 1. The following decks should be preceded by a cold start card, placed 
in the card reader hopper, and the buttons IMMEDIATE STOP (console), RESET 
(console), START (card reader), and PROGRAM LOAD (console) should be pressed. 
A blank card should be placed after the last deck in the card reader hopper. 

DECKS-LABELS: ANOVA-NOVA; STORE -STOR: GET-GETO; ANOV2-NOV2; 
SDOP-SDOP; MNSQ-MNSQ; REPRT-RPRT; *FMAT-FMAT; *FMTRD-FMRD; 
*DATRD-DTRD; *GMPYX-GMPY; *GDIVX-GDIV; *PRNTB-PRNB; TRAN-TRAN. 



*Used in all four analysis types 
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B. Execution from Disk 

Once the component subroutines and main calling programs are on the disk, the 
execution of a job requires the monitor control cards, program control cards, and 
data cards to be placed in the card reader. The deck should be preceded by a cold 
start card. To initiate processing, the buttons IMMEDIATE STOP and RESET 
(console), START (card reader) , and PROGRAM LOAD (console) should be pressed. 
The order in which the cards are placed in the card reader for either matrix or raw 
data input is shown in Figures 12 and 13. 



End of Data 



Data Deck 



/Optii 



Variable 
Format 



Job-Title 



Input/Output 
Units 



Monitor 
Control 



Table Generation Deck, 
i-includlng the end-of-deck 
indicator* 



*Final toble generator card 



Figure 12. ANOVA — card reader Input 
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(^Option 



Job-Title 



'Mnput/Output 
Units 



Monitor 
Control 



Table Generation Decic, 
-including the end-of-deck 
indicator* 



*Final table generator cord 



Figure 13. ANOVA - disk Input 



2.3.6 Sample Problem 

The data for this sample problem was taken, with permission, from page 276, 
Statistical Theory in Research , by R.L. Anderson and T.A. Bancroft. 
McGraw-Hill Book Company, Inc. , New York, 1952. 

INPUT 

// XEQ ANOVA 02 

*LOCALANOVA,FMTR0,PRNT3,0ATRD,ST0RE 

*L0CALAN0V2,SD0P,MNSQ,REPRT 

020200 

3333 TEST ANOVA-I 

030101060302 

('tIl,F4.0) 

111 161 

112 192 

121 145 

122 232 

131 172 

132 227 

211 166 

212 253 

221 231 

222 231 

231 204 

232 214 

311 113 

312 208 

321 131 

322 190 

331 104 

332 144 

411 103 

412 171 
421 158 
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422 
431 
432 
511 
512 
521 
522 
531 
532 
611 
612 
621 
622 
631 
632 



171 
135 
146 
132 
196 
176 
242 
178 
186 
180 
198 
216 
238 
175 
230 



BLOCKS 


0101 


FERTILIZER 


02 


VARIETY 


03 


F X V 


08 


ERROR 


-1050611 




OUTPUT 



// XEO ANOVA 02 

»LOCALANOVA»FMTRD»PRNTB»OATRO» STORE 
»L0CALAN0V2 ♦SDOP»MNSQ»REPRT 



ST ANOVA-1 

NUMBER OF FACTORS 
INPUT MODE 

TRANSFORMATION SWITCH 
NUMBER OF LEVELS - FACTOR 
NUMBER OF LEVELS - FACTOR 
NUMBER OF LEVELS - FACTOR 
NUMBER OF LEVELS - FACTOR 



3 

1 
1 
6 
3 
2 




(4I1*F4.0) 
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ANALYSIS OF VARIANCE TABLE FOR 6 X 3 X 2 X EXPERIMENT 



COMPONENT 



BLOCKS 
FERTILIZER 

VARIETY 

F X V 
ERROR 



TOTAL 



SUM OF 
SQUARES 


DEGREES OF 
FREEDOM 


MEAN 
SQUARE 


24938*91 
4034*00 


5 
2 


4987.78 

2017*00 


17292.25 


1 


17292.25 


1442*66 
9896*91 


2 
25 


721.33 
395.87 


57604.74 


35 





JOB COMPLETED 
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2. 4 LEAST-SQUARES CURVE FITTING BY ORTHOGONAL POLYNOMIALS 

Given m points (X^, Y^), i= 1, . . . , m, the (X) set not necessarily being equally spaced, 
this program will determine a polynomial of specified degree n or less, 

2 n 

y=a +a,x + a„x +...+ax 
o 1 2 n 

which best approximates these points in the least-squares sense; n should not be 
specified greater than ten; m, of course, must be greater than n, and for practical 
purposes should be considerably greater than n. The program allows the number of 
points, m, to be as high as^l^A. It is difficult to envisage a requirement such that 
n = 7 will not suffice; however, the program has been successfully tested on polynomials 
of order 16 with 134 data points, with accurate results. 

To maintain maximum accuracy, the program uses orthogonal polynomials, as described 
by G. E. Forsythe. * The process of finding the polynomial is accomplished by beginning 
with a first- and a second-degree polynomial and evaluating a variance criterion to 
determine whether the second-degree will offer a better fit than the first. If the 
variance criterion is satisfied within a specified tolerance, the program accepts the 
second-degree polynomial computed to be the best fitting polynomial. If not, the next- 
order poljmomial is computed and compared to the second-degree. The process con- 
tinues until the variance criterion is satisfied or a specified maximum degree reached. 
The degree of the last polynomial is assumed to be the best fitting polynomial for the 
data. 

The essential characteristics of the method are as follows: 

n 
Let y = X; c P (X) (1) 

j = ^ J 

where each P. (x) is a polynomial of degree j. 



By minimizing 

M = 
and letting 



2 
m r n -| 

2 [ ".-.?„ r,'vj 



m 



^jk=.S Pj(^i)Pk(V (3) 






(4) 



*Forsythe, G.E., "Generation and Use of Orthogonal Polynomials for Data Fitting 
with a Digital Computer", J. Soc. Indust. Appl. Math. 5, 1957; 74-78. 
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a set of normal equations are obtained 

n 



S. = yi c.r..; i = 0,l,2,...n. (5) 

^ k=0 •" ^^ 



Equation (5) consists of a set of n + 1 simultaneous equations with n + 1 unknowns. 

I are orthogon 

for j 7^ k 



However, as the polynomials P.(x) are orthogonal, then. 



'^JkM^ .2 



X; P.(x.) forj 
1=1 ■■ 



= k 



Under this condition, the coefficients c. can now be evaluated by 



The polynomials P.(x) are defined recursively by 
P_^(x) = 
P^(x) = 1 



P^(x) =(x- a^)P^(x) -^^P_j(x) 



Vl(^) =(x-a.^^)P.(x)-^.P._^(x) 



where 



m 

f-i X. P. (X.) 
1=1 i 1 L 

i=l •■ 



T 2 

f< P. (X.) 

1=1 J 1 



(6) 



S. 
c.=-^ j = 0,l,2 n (7) 



(8) 



j = 0, ...n (9) 



3= 1,2, ...n- 1(|8^=0) (10) 



T 2 
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The polynomial solution vectors c.. a^, and /3 are then used to compute a. the 
coefficients of the equation ■* •• J ]' 



y = a^ + a^x + a2X^ + ... a^ x" (H) 



for the degree n. 



In prmciple, the coefficients aj could be used in equation (11) to compute the fitted 
values for any given argument array. However, aj may change rapidly as n changes; 
therefore, it would be necessary to compute a. with great precision. To avoid this 
difficulty, fitted values use cj, a. and fi to compute P.(x) from equation (8). and 
simultaneously compute the fitted value;^^ from equation (1) . 

Similarly, the derivative computation uses c^ , a and to compute the riJl derivative 
of Pj(x) from the recurrence relation ■" •" 



ax dx dx •• dx 

r=l,2, ...,n j = 0,1,2,... n-1 

for any given set of arguments. 

If n and/or the range of x is large, the elements of the orthogonal vectors generated 
change rapidly in size; this imposes severe restrictions on accuracy. This becomes 
evident to the user by viewing the changes in the elements of successive vectors P(X, 
as J increases, or by viewing residuals, which in this case may tend to increase 
rather than decrease as j increases. 

To aid in circumventing this problem, the user is allowed to elect, on option, to have 
the program transform X to X' such that X' is in the range (-2,2) . This transformation 
will cause elements of Pj(X) to remain approximately uniform in size as j increases. 
The transformation used is 

''' = h-^-<-(i)^V)>]/V)-V)>' (1^) 

where x^.^ is the i*^-order statistic from the set (x). 

When this scaling is used, the following points must be considered: 

1. The values of cj and Pj(x') (equation (2)) are calculated and presented using x'. Since 
the y s are not transformed, the y*'s (estimated y's) and residuals calculated at x' 
are the same as those which would have been calculated at x if c, and P. had been 
obtained without transforming. •" •' 
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2. The coefficients a, from 



are actually a' , from 



n 

i=0 



y=E a;(x-)^ (14) 

i=0 ' 



3 If in addition to transforming x. the user elects to punch a, ^ . and c for later use 
' in obtaining y*'s from a new set of x's, that is, for later use in prediction, the 
transformation is retained, and the new x's will be transformed as were the origmal 
x's; y*'s for these new x's will be the same as the estimated y's would have been if 
transformations had not been performed. 

4. Derivatives are calculated using equation (14). 

dy _ dy dx' 
dx dx' dx 

5 The elements of P,(x') will now. as j increases, be of approximately the same size 
for all j. The elements of Pj (x') are related to those of Pj(x) by the factor: 



L''(m) - ^1)J 



2.4.1 Summary of Output 

1. (N,y) for all cases (x', y if scaling is elected). 

2. Pridicted value of y for S^d, 7^^ k^h-order polynomials. 

:5. Residuals for 3, 7, .... k^^^.Q^der polynomials, that is. if k=13, yypred. is given 
for k-3, 7, 11, and 13. 

4. Orthogonal polynomials of all degrees to k. 

.0. Polynomial solution vectors a , ^ , and c - used to generate orthogonal polynomials. 

f). Coefficients of fitted polynomial. 

7. Predicted values for externally supplied data set. 

8. k'h-order derivatives of the polynomial at user-specified points, where k is the 
order of the polynomial. 

9. Scaling equation used, if required. 
10. Analysis of Variance Table. 
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2.4.2 Job Execution 

To perform a polynomial regression analysis, the user must si5)ply three sets of cards 
to the program: 

1. Monitor control cards 

2. Program control cards^^ ' 

3. Data cards 

Monitor Control Cards 

The monitor control cards are necessary to initiate program loading from the disk and 
to establish the necessary communication with the monitor. A general description of 
the cards may be found in IBM 1130 Disk Monitor System Eeference Manual (C26-3750). 

The orthogonal polynomial program requires the following cards: 

CC: 14 8 16 

// XEQ POLY 02 

*LOCALPOLY, TRAN, DATED, FMTRD, PRNTB 
*LOCALPOL2, POLSQ, PCOEF, PDER, PFIT 

Monitor control cards do not change from job to job, but must be included with every 
job processed. The first program operated on by this system should be preceded by a 
cold start card. 

Program Control Cards 

The program control cards communicate the data-specific parameters, and output options 
to the program. The four possible card types are described below. 

1. Input/output units card* 

2. Job-title card* 

3. Option cards (described below) 

4. Variable format card* 

TYPE I OPTION CARD 

This type of option card is to be used when data is being entered into the program for 
the initial computation of the best fitting polynomial. 



*See "General Operating Instructions", section 1.2. 
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Maximum Degree of Polynomial (cc 1-2) 

« This field should be punched with an integer, n, which is less than or equal to ten. The 

^ program attempts to fit a polynomial to the data points until the variance criterion 

punched in columns 17-26 is satisfied by successive-degree polynomials. If the 
variance criterion is not satisfied when the degree of the polynomial reaches n, the 
program prints a message to this effect and continues, using the solution to the 
nth-degree polynomial. The value of n, should be less than m+1, where m is the 
number of the data points read. 

Input Source (cc 3-4) 

This field must be punched with an integer, n, which assumes a value of either one (1) 
or two (2) . 

If n is equal to 1, the data points, followed by a negative identification card, are read 

, from the 1442 card reader. If n is equal to 2, the data points are read from the disk, 

'^ having previously been transferred there by a program using input mode 1. The data 

on the disk is destroyed by any program using input mode 1. As noted below (Secondary 
Input Sources), input type 3 also destroys disk data. 

Coefficients of Fitted Polynomial (cc 5-6) 

In the determination of the best fitting polynomial, the computation involves only the 
orthogonal polynomials and the three associated vectors called the polynomial solution 
■^ vectors. The orthogonal polynomials are generated from the solution vectors whenever 
it is necessary. Hence, the actual coefficients of the fitted polynomial are not required 
for evaluation of derivatives of the computation of estimated values. However, if 
desired, they may be printed by punching one (1) in the field. If this field is left blank 
or contains a zero, the coefficients are not printed. 

Evaluate Derivative Switch (cc 7-8) 

^ This field is used to indicate whether derivatives are to be evaluated at a selected list 
of points. If this field contains a zero or is blank, the derivatives are not computed. 

If this field contains a one (1), each data point is examined to determine whether the 
derivative computation Indicator for that point is nonzero. When a nonzero indicator is 
located for a particular value of x, the program evaluates the kth-order derivatives, 
where k Is an integer punched in cc 9-10. The printout Includes the 1,2,..., kth-order 
derivatives and the estimated value of y for that particular value of x. 

Maximum Order Derivatives (cc 9-10) 



O' 



c? If cc 7-8 contains a one (1), this field must be pimched with an Integer, k, which is less 

than or equal to the order of the polynomial. It indicates the maximum order derivative 
to be computed when a nonzero derivative computation Indicator is located. The printout 
Includes all lower-order derivatives as well as the maximum. 
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Predicted Values (cc 11-12) 

The value of y, as estimated, is printed for each data point, x; y is also estimated and 
printed with the orthogonal polynomials unless the user does not elect to have them 
printed (cc 31-32). 

Punch Solution Vectors Switch (cc 13-14) 

If this field contains a one (1), the polynomial solution vectors are punched in the 
standard matrix format (section 2.1.4). If the field contains a zero or is left blank, 
the solution vectors are not punched. 

To maintain maximum numerical accuracy in computing the coefficients of the fitted 
polynomial derivatives and estimated values, the orthogonal polynomials are used for 
the computation. However, to conserve storage space, the orthogonal polynomials are 
recomputed each time they are used. The polynomial solution vectors as functions of 
the data points are used as parametric vectors in this computation to avoid making more 
than one pass through the original data. In effect, the solution vectors are used 
throughout the program to represent the coefficients of the fitted polynomials. Hence, 
if the user e35)ects to use the polynomial to compute additional values or derivatives, 
the solution vectors should be punched out. In addition to the solution vectors, the first 
output card includes the scaling constants required for evaluating y and derivatives at 
x' . If scaling is not performed, this card Is still punched, and read (but not used) , under 
input mode 3. 

Variance Criterion (cc 17-26) 

This field must be punched with a positive floating-point number of the form 
.XXXXXXXXX. The number should Include the decimal point, which may be placed 
anywhere in the field. No blank columns are allowed. 

The variance criterion Is used to determine when the best fitting polynomial has been 
computed. The process of fitting the points involves the computation of successively 
higher-degree polynomials. As each degree computation is completed, a variance 
criterion is developed. When the difference between any two successive variances Is 
less than the variance criterion punched in this field, the best fitting polynomial is 
assumed to have the degree of the last polynomial computed. If, however, this condition 
Is not met before the maximum degree polynomial, as defined In cc 1-2, Is satisfied, 
the maximum degree Is the degree used. If the user has no feeling for the magnitude of 
this number, . 01 may be used. 

Transformation Switch (cc 27-28) 

If this field is nonzero, a user-written transformation routine is called (see section 
2.5.1). TRAN is called before any scaling that the user might elect to have the program 
perform. 



^J 
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Scaling Switch (cc 29-30) 

If this field is nonzero, x is scaled by a linear transformation to x' such that the 
elements of x are in the range (-2, 2). All calculations then deal with the data set 
(x',j) (see section 2.4). 

Polynomial and Residual Output (cc 31-32) 

If this field is nonzero, only the coefficients of the polynomial y=aQ + a^^x + + a^x" 

are presented; the residuals, y-y*, y*, and P.(x) are not listed. 

This option is helpful if solution vectors are punched, for later evaluation of y at new 
points X*, when y at x is not desired. 

Curve Fitting Type I Option Card Summary 

Column Meaning 

1-2 Maximum degree of polynomial to be fitted 

3-4 Input source 

1 - Raw data input from card reader 

2 - Raw data input from disli 

5-6 Coefficients of fitted polynomial switeh 

- Do not print 

1 - Print 



7-8 


Evaluate derivatives switch 




- No derivatives 




1 - Derivatives 


9-10 


Maximum order derivative 


11-12 


Predicted values 




- Do not print 




1 - Print 



13-14 Polynomial solution vectors punch switch 

- Do not punch 

1 - Punch 

15-16 Must be zero or blank 

17-26 Variance criterion 

27-28 Transformation switch (to user-written program) 

- Do not call THAN 

1 - Call TRAN 

29-30 Nonzero: Scale x into (-2, 2) 

31-32 Nonzero: Do not print polynomials, predicted values, or residuals 
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TYPE n OPTION CARD 

This type of option card is to be used whenever data is entered into the program with a 
previously computed set of polynomial solution vectors. 

Degree of Polynomial (cc 1-2) 

This field is used to transmit the degree of the previously computed polynomial solution 
vectors that are to be read by the program. 

Input Type (cc 3-4) 

This field must be punched with a three (3) . 

This program uses this number to read in the polynomial solution vectors that were 
punched from a previous analysis. In addition to these solution vectors, necessary 
scaling constants from the previous analysis are also read. It is necessary to keep all 
punched output from analyses in the order in which it was punched, for later input. 

In effect, the solution vectors represent the coefficients of thd fitted polynomial. Hence, 
this option is to be used when it is desired to use the fitted polynomial to compute 
additional estimated values and/or to compute additional derivatives for points other 
than those used in the initial analysis. The data points are read under the secondary 
input type indicated in cc 15-16. If no data points are read for evaluation of y, only 
coefficients are calculated. However, in this case, these have already been calculated 
for the previous analysis. If the secondary input type is the card reader, previously 
read input, which was placed on the disk, is destroyed. 

Coefficients of Fitted Polynomial (cc 5-6) 

In the determination of the best fitting polynomial, the computation involves only the 
orthogonal polynomial and the thr^e associated vectors called the polynomial solution 
vectors. The orthogonal polynomials are generated from the solution vectors whenever 
it is necessary. Hence, the actual coefficients of the fitted polynomial are not required 
for evaluation of derivatives or the computation of estimated values. However, if 
desired, they may be printed by punching a one (1) in this field. If this field is left 
blank or contains a zero, the coefficients are not printed. 

Evaluate Derivative Switch (cc 7-8) 

This field is used to indicate whether derivatives are to be evaluated at a selected list 
of points. If this field contains a zero or a blank, the derivatives are not computed. 

If this field contains a one (1), each data point is examined to determine whether the 
derivative computation indicator for that point is nonzero. When a nonzero indicator is 
located for a particular value of x, the program evaluates the kth-order derivatives, 

where k is an integer punched in cc 9-10. The printout includes the 1,2 kt^-order 

derivatives and the estimated values of y for that particular value of x. 
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Maximum Order Derivatives (cc 9-10) 

If cc 7-8 contains a one (1), this field must be punched with an integer, k, which is less 
than or equal to the order of the polynomial. It indicates the maximum order derivative to be 
computed when a nonzero derivative computation indicator is located. The prmtout 
includes all lower-order derivatives as well as the maximum. If the order is given as 
zero, no derivatives are calculated. 

Estimated Value Switch (cc 11-12) 

This field is used to indicate whether estimated values are to be computed for the 
values of x read in by the programs. If this field contains a zero or is left blank, the 
estimated values are not computed. If a one (1) is punched, the estimated values are 
computed. 

Se condary Input Sources (cc 15-16) 

This field must be punched with an integer one (1) or two (2). 

If a one (1) is entered, the data points, followed by a negative identification card, are 
read from the 1442 card reader, and onto the disk, destroying previously stored data. 
If a two (2) is entered, the data points are read from the disk. If no data points are 
entered, the format card is still required, and the first card succeeding the solution 
vector deck is read as the new data card. If this card is blank, a y at x = zero is 
evaluated. 

If the user-written program THAN was called, for initial analysis of the data, the user 
should be sure that it is called to operate on the new data. 

Cu rve Fitting Type II Option Card Summary 

Column Meaning 

1-2 Degree of polynomial 

3-4 Input type 

3 - Polynomial solution vectors from card reader 

5-6 Coefficients of fitted polynomial 

- No 

1 - Yes 

7-8 Evaluate derivatives 

- No 

1 - Yes 

9-10 Maximum order derivatives 
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Column 



Meaning 



11-12 


Compute estimated values 




- No 




1 - Yes 


13-14 


Not used 


15-16 


Secondary input source 



1 - Raw data from card reader 

2 - Raw data from disk 



17-26 


Not used 


27-28 


Transformations 




- Do not call TRAN 




1 - Call TRAN 



29-32 



Not used (however, x is scaled if the x's were scaled for the 
previous analysis) 



2.4.3 Data Input 

Raw data input to the program consists of a set of points (x, y) punched on cards, one 
poiat to a card, with associated identification. The general form for this input can be 
described in terms of individual fields for each item on the card. 



riAA 



Field 



X^J^ ^3 



Type 
Integer (I) 



Integer (I) 



Floating 
point (F) 



Floating 
point (F) 



Meaning 

Card identification. Any numeric information that serves to 
identify the point (x,y). The number punched in this field 
must be greater than zero. 

Derivative computation indicator. The program computes 
derivatives at any point specified in the d^ta set. If the user 
wishes to have a derivative of the polynomial evaluated at the 
point punched on this card, this field should contain a one (1). 
The order of derivative to be computed is specified on the 
option card. If this field contains a zero (0), the derivative 
is not evaluated at this point. 

The value of x. Any floating-point number is allowed. The 
values of.x need not be equally spaced. Scaling of data may 
be required. 

The value of y. Any floating-point number is allowed. 



/'/ 



.;/ 
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The particular card columns for each field are arbitrary as long as all four fields are 
present on the card. 

Following the data deck, the user must include a card containing a negative integer in 
the identification field. This card signals the program that no more data points are to 
be processed. 

2.4.4 Operating Instructions 

A. Using the polynomial regression program when the total 1130 Statistical System 
has not been stored on the disk 

If the user wishes to load only the set of programs that allow this type of analysis, 
the following programs must be compiled or assembled and stored on the disk. Each 
deck begins with a card punched as 

//FOB 

and ends with an 

*STORE 

card. 

The user should use a disk containing the 1130 Disk Monitor System, as described 
in section 1.1. The following decks should be preceded by a cold start card, placed 
in the card reader hopper, and the buttons IMMEDIATE STOP (console) , RESET 
(console), START (card reader), and PROGRAM LOAD (console) should be pressed. 
A blank card should be placed after the last deck in the card reader hopper. 

DECKS-LABELS : POLY -POLY; POL2-POL2; POLSQ-PLSQ;PCOEF-PCOF; 
PFIT-PFIT; PDER-PDER; +FMAT-FMAT; *FMTRD-FMRD; *DATRD-DTRD; 
+PRNTB-PRNB; *GMPYX-GMPY; *GDIVX-GDIV; TRAN-TRAN. 

B. Execution from Disk 



Once the component subroutines and main calling programs are on the disk, the 
execution of a job requires the monitor control cards, program control cards, and 
data cards to be placed in the card reader. The deck should be preceded by a cold 
start card. To initiate processing, the buttons IMMEDIATE STOP and RESET 
(console), START (card reader), and PROGRAM LOAD (console) should be pressed. 
The order in which the cards are placed in the card reader for solution vector, disk, 
or raw data input is shown in Figures 14, 15, and 16. 



*Used in all four analysis types 
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Monitor 
Control 



Data Deck 



[^Opti< 



Variable 
Format 



[^Job-Title 



Input/Output 
Units 



Optional 
Blank Output 



Negative 
Identification 



Figure 14. Orthogonal polynomial card order — card reader input 







/ 


/ 








''Optional 
Blank Output 


/ 




/« .. 










f ^jprion 










Job-Title 
















/ 








Input/Output 
Units 






/ 


/' 








/ 








Monitor 
Control 


/ 







Figure 15. Orthogonal polynomial card order — dislt input 



^ 



End of Data 



New Data 

Deck 



fopt^ 



Variable 
Format 



Polynomial 
Solution 

Vectors* 



fjob-TitI 



Input/Output 
Units 



Monitor 
Control 



*lncluding scaling constants card 



Figure 16. Orthogonal polynomial card order — solution vector input 
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2.4.5 Sample Problem 

The data for this sample problem was taken, with permission, from page 213, 
Statistical Theory in Research , byR. L. Anderson and T. A. Bancroft. 
McGraw-Hill Book Company, Inc., New York, 1952. 



INPUT 

// XEQ POLY 02 

*L0CALP0L2,P0LSQtPC0EF,PDER, PFIT ; 

*LOCALPOLY,TRANtOATRD,FMTRD,PRNTB 

020200 

lUl ORTH POLY (NO SCALING) 

0201010102 010100.010000000000000 

(12, I1,1X,F2.0,F3. 1) 

on OlOll 

020 020lri 

031 03110 

040 04126 

051 05147 

060 06199 

071 07251 

080 08239 

091 09231 

100 10236 

111 11260 

120 12246 

-1 

PUNCHED OUTPUT 




The numbers on this first card 
are valid only when the user 
elects to scale (see section 
2.4.2). When scaling is not 
performed, they reflect prior 
core status and should be 
ignored (that is, they can 
take on any value). 



0.3636363E 00 0.1636363E 01 

111124 1 1 0.6500000E 01 0.1191666E 02 0.1772499E 02. 

111124 1 2 0.6500000E 01 0.9333328E 01 0.2105245E 01 

111124 1 3 0.6500000E 01 0.8678567E 01-0. 25616 86E 00 

OUTPUT 
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// XFO POLY 0? 

»l0calo0l2.p0ls0*dc0ff.p0er»pfit 
*localooly»tran»datrd»fwtrd.prntb 



ORTH POLY (NO SCALING) 

MAXIMUM! DEGREE OF POLYNOMIAL 
INPUT TYPE 

POLYNOMIAL COEFFICIENTS 
COMPUTE DERIVATIVES 
ORDER OF DERIVATIVE 
PREDICTED VALUFS 
PUNCH SOLUTION VECTORS 
SECONDARY INPUT TYPE 

VARIANCE CRITERION O.UlOOOOOOl 
TRANSFORMATION SWITCH o 

SCALING 

IGNORE POLYNOMIAL OUTPUT 



(I2.I1»1X«F2,0,F3,1) 



X » X' (NO TRANSFORMATION) 



MAX DFGREF OF POLYNOMIAL REACHED. VARIANCE CRITERION NOT SATISFIED 
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ORTH POLY (NO SCALING) 



IDENTIFICATION 



1 

2 
3 

6 
7 
B 
9 

10 
11 
1? 



-1 

2 

-3 

-5 
f- 

-7 
8 
-9 
12 
-11 
1? 



X' 

O.IOOOOE 01 

0.20000E 01 

0,3UU00E 01 

0.'40000E 01 

O.IOOOOE 01 

Ot60000E 01 

0.70000E 01 

O.SOOOOE 01 

o,9noooE 01 

O.IOOOOE 02 

O.llOOOE 02 

0,!2000E U2 



O.llOOOE 
0.71000E 
U.llOOvJE 
U.12600E 
0.1<.700E 
0.19'JOOE 
0.25100E 
U.2390UE 
0.23100E 
;).2 3600E 
U,2600UE 
\J,2'tb'.lOE 



ORTHOGONAL POL 
Y» 
0.1't't97E 01 
0.61166E 01 
0.1U271E 02 
0.13913E 02 
0.170't3E 02 
0.19661E 02 
0.21766E 02 
0, 233596 02 
0.2't'.39E 02 
0.25007E 02 
0.25U63E 02 
Ll.ZihoTE 02 



YNOMIALS 

Y-Y» 
0.3't972E 00 
0,9a334E 00 



00 
01 



0,72875E 

0.13134E 

0.23'(3'tE 01 

0.23699E 00 

0,33337E 01 

0.640B'tE 00 

'0.13397E 01 

'0,14079E 01 

0.9361<tE 00 

■0.7i,0HlE-0 2 

ALPHA 

BETA 

C 



O.IOOOOE 01 

O.IOOOOE 01 

U.IUUOUE 01 

O.IOOOOE 01 

O.IOOOOE 01 

O.IOOOOE 01 

U.IOOOUE 01 

O.IUOOUE 01 

O.IOOOOE 01 

O.IOOOOE 01 

O.IOOOOE 01 

O.IOOOOE 01 

0.65000E 01 

0.11916E 02 

0.1772'.t 02 



1 

-O.aSOOOE 01 

-0.*5000E 01 

-O.35O0OE 01 

-0.2bOOOE 01 

-0.15000E 01 

-O.5O00OE 00 

O.SOOOUt 00 

0.1500UE 01 

0.2bOOOE 01 

o.asooot 01 

O.itSOOOt 01 

0.550OOE 01 

0.650iJUt 01 

0.93333t 01 

0.210!)2t 01 



nil 



0.18333E 02 
0.83333E 01 
0.33333E 

-O.bbbbbE 

-0.9&6&6E 

-0.11666E 

-0.11666E 02 

-0.9666bE ol 

-O.^bbbbE 
0.333J3E 
0.83333E 01 
0.1b3J3h u2 
0.6SO00E 01 
QtOblobE wi 

-0.2iblbt 00 



00 
01 
01 
0^' 



00 



VARIATION SOURCE 



ANALYSIS OF VARIANCE 

D.F. SUM OF SQUARES 



riEr^REF 1 COMPONENT 1 

t!FSI[)OALSI'>EGPEE 1 REGR.I 10 



DF-CiOFc 2 CCPINENT 
RFSIDJALSIDEGREE 2 REGr<.l 



0.63378E 03 
0.11254E 03 



0.87i)a3E 02 
0.24957E 02 



MEAN SQUARE 



0.b3378E 03 
0.1126'.E 02 



0.B7583E 02 
0.27730E 01 



ORTH POLY (NO SCALING) 



JOB 



1111 



PAGE 



COEFFICIENTS OF FITTED POLYNOMIAL 

-0.3729b47E 01 

1 0.5435437E 01 

2 -0.2361686E 00 



ORTH POLY (NO SCALING) 



JOB 



1111 



PAGE 



IDENTIFICATION 
-1 
-3 
-5 



-11 



1.00000 
3.00000 
5.00000 
7.00000 
9.00000 
11.00000 



Y» 
1.44972 
10.27124 
17.04342 
21.76624 
24.43972 
25.06385 



DERIV. ORDER 



DERIV. VALUE 



4.92309 
-0.51233 

3.69842 
-0.51233 

2.87375 
-0.51233 

1.84907 
-0.51233 

0.82440 
-U. 51233 

-0.20027 
-0.51233 
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ORTH POLY (NO SCALINOI 
rOENTIFICATION X' 



JOB 1111 





-1 


O.IOOOOE 


01 


O.llOOOE 


01 


0.U'.97E 


01 


-0.34972E 00 






0.20000E 


01 


0.71000E 


01 


0.61166E 


01 


0.98334E 00 




"3 


0,30000E 


01 


o.unooE 


02 


0.10271E 


02 


0.72875E 00 






0.40000E 


01 


0.12&OOE 


02 


0.13913E 


02 


-0.13134E 01 




"5 


0.50000E 


01 


0.U700E 


02 


0.17043E 


02 


-0.23't34E 01 






0.60000E 


01 


0.19900E 


02 


0.19661E 


02 


0.23B99E 00 




-7 


0.70000E 


01 


0.2S100E 


02 


0.21765F 


02 


0.33337E 01 






0.80000E 


01 


0.23900E 


02 


0.23359E 


02 


0.S't0B4E 00 




-9 


0.90000E 


01 


o.23lonE 


nz 


0.24439E 


02 


-0.13397E 01 


10 


10 


O.IOOOOE 


02 


0.23600E 


02 


0.2S007E 


02 


-0.14079E 01 


11 


-11 


O.llOOOE 


02 


0.26000E 


02 


0.25063E 


02 


0.93614E 00 


12 


12 


0.12000E 


02 


O.24&O0E 


02 


0.24607E 


02 


-0.7ft08lE-02 


JOB COMPILETEO 



















INPUT 

// XEQ POLY 02 

*LOCALPOL2,POtSQ,PCOEF,P0ER,PFIT 

♦LOCALP0Lr,TRAN,DATR0,FMTRO,PRNTB 

020200 

im ORTH POLY (SCALING) 

0201010102010100.010000000000100 

(I2.Il,lX,F2.0tF3.n 

Oil 01011 

020 02071 

031 03110 

040 04126 

051 05147 

060 06199 

071 07251 

080 0B239 

091 09231 

100 10236 

111 11260 

120 12246 

-1 

PUNCHED OUTPUT 

0.3636363E 00-0.2363636E 01 1 
111124 1 1 0.3178914E-06 0.1575755E 01 0.1772499E 02 
2-0.1016575E-06 0.1234159E 01 0.5789424E 01 
3 0.3039385E-06 0.1147578E 01-0. 1937265E 01 

OUTPUT 



111124 1 
111124 1 



// XEQ POLY 



02 



»L0CALP0L2»P0LS0.PC0EF.PDEl!ltPFIT 
•LOCALPOLY.TRAN»DATRO»FMTRD»PRNTB 
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ORTH POLY (SCALING) 

MAXIMUM DEGREE OF POLYNOMIAL 2 

INPUT TYPE 1 

POLYNOMIAL COEFFICIENTS I 

COMPUTE DERIVATIVES 1 

OROE^ OF DFRIVATIVE 2 

PREDICTED VALUES 1 

PUNCH SOLUTION VECTORS I 

SECONDARY INPUT TYPE 

VARIANCE CRITERION O.OIOOOOOOI 

TRANSFORMATION SWITCH 

SCALING 1 

I.6N0RE POLYNOMIAL OUTPUT 



JOB Xlll 



PAGE 



(I2tIl«lX.F2«0«F3«X) 



THE X VALUES HAVE BEEN TRANSFORMED TO X'-( 0.3636363E 00)»X ♦ (-0.2363636E 01). 



MAX DEGREE OF POLYNOMIAL REACHED. VARIANCE CRITERION NOT SATISFIED 



OUTH DOLY (SCALING! 



JOB 



IIU 



PAGE 















OHThOGONAL POLYNOMIALS 








OrMTIFICATION X< 
1 -1 -0.19999E 


01 


Y 
O.llOOOE 


01 


Y« 
0.1'.'.97E 01 


Y-V» 
-0.3'.97*E 00 



1.000000 


1 
-2.000000 


2 
2.42424E 


2 


2 


-0.16363E 


CI 


0.71000E 


01 


0.61166E 01 


0.98334E 00 


1.000000 


-1.636363 


1.101921 


3 


*3 


-0,12727E 


01 


O.llOOOE 


02 


0.10271E 02 


0.72e7JE 00 


1.000000 


-1.272727 


0.0'i<)07S 
-0.7*9301 


u 


u 


-0.90909E 


CO 


D.12600E 


02 


0.13913E 02 


-0.1313<>E 01 


1.000000 


-0.909091 


5 


-i 


-O.SAS'tSE 


00 


0.1*700E 


02 


0.170*3E 02 


-0.23434E 01 


1,000000 


-O.S<>5<>5<> 


-1.27B23S 


6 


6 


-O.lRiaiE 


00 


0.19900E 


02 


0.19660E 02 


0.23902E 00 


1.000000 


-0.181818 


-1.3*2697 


7 


-7 


0.1R181E 


00 


0.2J1UOE 


U2 


0.21766E 02 


0,33337E 01 


l.OOOOOU 


0.181817 


-1.5*2697 


R 


B 


0>5<>S4SE 


00 


0.2390OE 


02 


0.233S9E 02 


0.l>'t086E 00 


1.000000 


O.S'.S'.S* 


-1.278235 


9 


-9 


0.90909E 


00 


0.2310OE 


02 


0.2*'.39E 02 


-0.13397E 01 


1.000000 


0.909090 


-0.7*9310 


10 


10 


0,12727E 


01 


C.23600E 


02 


0.2S007E 02 


-C,U079E 01 


1.000000 


1.272726 


0.0**071 


11 


-11 


0.1(i363E 


01 


0.26000E 


02 


C.25063E 02 


0.93614E 00 


1.000000 


1.636363 


1.101928 


12 


12 


0.20000E 


01 


0.246UUF 


02 


0.2't607E 02 


-0.7'.310E-O2 

ALPHA 

BETA 

C 


1.000000 
0.31789E-06 
0.15757E 01 
0.1772*E 02 


1.999999 

-0.1016!>E-06 

0.123O1E 01 

0.5789'.t 01 


2.*2*2*2 

0.3U393E-U6 

0.11*7SiE 01 

-0.19372E 01 



REAOY JHf PUNCH WITH PLANK CARDS AND PRESS STA«T ON THE PUNCH AND CONSOLE. TURN CONSOLE SWITCH 15 ON. 



VARIATION SOURCE 



ANALYSIS OF VARIANCE 

D.F. SUM OF SQUARES 



DEGREE 1 COMPONFNT 1 

RESIDUALS(OEGREE 1 REAR.) 10 

DEGREE 2 COMPONENT 1 

KESIDUALSIDEGREE 2 REGR.I 9 



0.63378E 03 
0.1125*E 03 



0.8758*E 02 
0.2*956E 02 



MEAN SQUARE 



0.63378E 03 
0.112S*E 02 



0.e7S8*E 02 
0-277J9E 11 



ORTH POLY (SCALING! 



JOB 



nil 



PAGE 



COEFFICIENTS OF FITTED POLYNOMIAL 



0.2077764E 02 

0.5789<»2<»E 01 

-0.193726SE 01 
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09TH 


OOLY 


ISCALING) 








JOB 


IDENTIFICATION 


X' 


Y» 


DERIV. 


ORDER 


DERIV. VALUE 


-1 




-1.99999 


1.4<i97* 


1 
2 




13.53848 
-3.97453 


-3 




-1.27272 


10.2712* 


1 
2 




10.72064 
-3.87453 


-6 




-0.5'.5't5 


17.0*340 


1 
2 




7.90280 
-3.87453 


-7 




0.18181 


21.76622 


1 
2 




5.08496 
-3.87453 


-9 




0.90909 


24.43971 


1 
2 




2.26712 
-3.87453 


-U 




1.63636 


25.06386 


1 
2 




-0.55071 
-3.87453 



ORTH POLY (SCALINGI 
IDENTIFICATION X' 



1 


-1 


-0.19999e 


01 


O.llOOOE 


01 


0.14497E 


01 


-0.34974E 


on 


2 


2 


-0.16363E 


01 


0.71000E 


01 


0.61166E 


01 


0.98334E 


00 




-3 


-0.12727E 


01 


O.llOOOE 


02 


0.10271E 


02 


0.72e75E 


on 






-0.90909E 


00 


0.12600E 


02 


0.13913E 


02 


-0.13134E 


nl 


5 


-5 


-0.54545E 


00 


0,14700E 


02 


0.17043E 


02 


-0.23434E 


01 


6 




-o.ieisiE 


00 


0.19900E 


02 


0.19660E 


02 


0.23902E 


00 




-7 


0.18181E 


00 


0.25100E 


02 


0.21766E 


0? 


0.33337E 


01 


8 




0.54545E 


00 


0.23900E 


02 


0.23359E 


02 


0.54086E 


no 






0.90909E 


oo 


0.23100E 


02 


0.24439E 


02 


-0.13397E 


nl 


10 


10 


0.12727E 


01 


0.23600E 


02 


0.25007E 


02 


-0.14079E 


nl 


11 


-11 


0.16363E 


01 


0,2600OE 


02 


0.25O63E 


02 


0.93614E 


on 


12 


12 


0.20000E 


01 


0.24600E 


02 


0.24607E 


02 


-0.74310E- 


02 



JOP COMPLETED 



INPUT 

// XEQ POLY 02 

♦L0CALPDL2,P0LSQ,PC0EF,PDER,PFIT 

♦LOCALPOLY,TRAN,DATRO,FMTRD,PRNTB 

020200 

1111 ORTH POLY (NO SCALING, SOLUTION VECTOR INPUT) 

020301010201000100000000000000000 

(I2,II,1X,F2.1,F3.0) 

0.3636363E 00 0.1636363E 01 

111124 1 1 0.6500000E 01 0.1191566E 02 0.1772499E 02 

111124 1 2 0.6500000E 01 0.9333328E 01 0.2105245E 01 

111124 1 3 0.6500000E 01 0.8678567E 01-0.2561686E 00 

010 05000 

020 55000 

031 10000 

-1 



_A- 



OUTPUT 



These numbers were produced 
In the first sample problem, and 
as explained there, are not used. 
However, the card is necessary. 
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// XEO POLY 02 

♦L0CALP0L2 fPOLSO »PCOEF • PDER ♦PF I T 

•LOCALPOLY»TRAN.DATRD.FMTRD»PRNTB 



ORTH POLY (NO SCALING. SOLUTION VECTOR INPUT) 

MAXIMUM DEGREE OF POLYNOMIAL Z 

INPUT TYPE 3 

POLYNOMIAL COEFFICIENTS I 

COMPUTE DERIVATIVES 1 

ORDER OF DERIVATIVE 2 

PREDICTED VALUES I 

PUNCH SOLUTION VECTORS 

SECONDARY INPUT TYPE I 

VARIANCE CRITERION 0.000000000 

TRANSFORMATION SWITCH 

SCALING 

IGNORE POLYNOMIAL OUTPUT 



JOB 1111 



PAGE 



II2«I1»1X.F2.1.F3.0) 



X' (NO TRANSFORMATION! 



ORTH POLY (NO SCALINGi SOLUTION VECTOR INPUT! 
COEFFICIENTS OF FITTED POLYNOMIAL 



JOB 1111 



PAGE 



-0.3729551E 01 



0.5435436E 01 
-0.25616il6E 00 



ORTH POLY INO SCALING* SOLUTION VECTOR INPUTI 



JOB 1111 



PAGE 



IDENTIFICATION 



X' 

l.OOOOO 



DERIV. ORDER 



DERIV, VALUE 



4.92309 
-0.S1233 



ORTH POLY (NO SCALING. SOLUTION VECTOR INPUTI 
IDENTIFICATION X' Y 



JOB 



PAGE 



1 


1 


0.50000E 00 


O.OOOOOE 


00 


-n.lOTSSE 


01 


0.10758E 


01 


7 


7 


O.SBOOOE 01 


O.OOOOOE 


00 


0.18'>16E 


02 


-o.istieE 


02 


3 


-3 


O.IOOOOE 01 


o.oonnoE 


00 


0.1**97E 


01 


-0.1*497E 


01 



JOB COMPLETED 



108 



INPUT 



// XEQ POLY 02 

*LOCALP0l.2,P0LS0.PCOEF,P0ER,PFIT 
*LOCALPOLY,TRAN,DATR0,FMTRD,PRNTB 
020200 

nil ORTH POLY (SCALING, SOLUTION VECTOR INPUT) 

020301010201000100000000000000000 

<I2,ll,lX,F2.1,F3.0) 

0.3636363E 00-0.2363636E 01 1 
111124 1 1 0.3178914E-06 0.1575755E 01 0.1772499E 02 

01 



111124 1 2-O.I016575E-06 0.1234159E 01 0.5789424E 



111124 1 3 
010 05000 
020 55000 
031 10000 
-1 



0.3039385E-06 0.1147578E 01-0. 1937265E 01 



OUTPUT 



// XEO POLY 



02 



»LOCALP0L2»POLSO»PCOEF»PDER»PFIT 
*LOCALPOLY»TRANiDATR0tFMTRD«PRNTB 



ORTH POLY <SCALING. SOLUTION VECTOR INPUT) 



JOB nil 



PAGE 



MAXIMUM DEGREE OF POLYNOMIAL 2 

INPUT TYPE 3 

POLYNOMIAL COEFFICIENTS 1 

COMPUTE DERIVATIVES 1 

ORDER OF DERIVATIVE j 

PREDICTED VALUES 1 

PUNCH SOLUTroN VECTORS 

SECONDARY INPUT TYPE I 



VARIANCE CRITERION 
TRANSFORMATION SWITCH 

SCALING 

IGNORE POLYNOMIAL OUTPUT 



0.000000000 




(12,11. IX, F2.1,F3,0) 



THE X VALUES HAVF BEEN TRANSFORMED TO X'.( 0„3636363E 00)»X ♦ I-0.2363636E Oil, 



ORTH POLY (SCALING, SOLUTION VECTOR INPUT) 
COEFFICIENTS OF FITTED POLYNOMIAL 



JOB nil 






0.2077764E 


02 


1 


0.57e9*24E 


01 


2 


-0.1937265E 


01 
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ORTH POLY (SCALING. SOLUTION VECTOR INPUT) 



InENTIFlCATION 



DERIV. ORDER 



Joe IIU 

DERIVi VALUE 



PAGE 



13.53848 
-3.87*53 



ORTH POLY (SCALING. SOLUTION VECTOR INPUT) 
IDENTIFICATION X" Y 



JOB 



1 


1 


-0.21818E 01 


? 


2 


-0.36363E 00 


3 


-3 


-0.19999E 01 



0<OOOOOE 00 -0«107S8E 01 
O.OOOOOE 00 0.18416E 02 
O.OOOOOE 00 0.1**97E 01 



0.107S8E 01 
-a.l8416E 02 
-0.14*97E 01 



JOB COMPLETED 



110 



2. 5 GENERAL NOTES ON THE PROGRAMS 

2.5.1 Transformations 

This feature was added to aid users who are familiar with programming (see the manuals 
1130 FORTRAN Language (C26-5933) and 1130 Disk Monitor System (C26-3750)) in adding 
transformation capability to the system. Currently, a subroutine TRAN is included in the 
package, and is called on option by each main program, subsequent to the reading of each 
observation. The current routine returns to its calling program immediately. 

In implementing such a subroutine, the following points should be considered: 

1. In the regression and factor analysis programs, the observation (row) X is in 
COMMON storage, and can be reached by use of the COMMON statement in the 

user-written program. The row X contains one observation on Xj, Xj^, and 

TRAN could be written using the row X as an argument. 

2. In the orthogonal polynomial program, TRAN is called after each reading of x^, yy 
which are elements of vectors X, Y, in COMMON. TRAN could have arguments 

X. and/or y., or could use the COMMON statement. 

3. For the analysis of variance program, TRAN should include the argument DATA, 
containing the observation. 

4. If a large transformation program is prepared by the user, storage requirements 
may call for the use of LOCAL monitor facilities. 

5. Transformations that modify the number of variables in the observation require 
modification to the program supplying and analyzing the data. Such modifications 
require programming knowledge of the package. For example, if one originally 
entered ten variables, and wished to transform the sum of four of them into one 
column of the observation matrix, the sum should be placed in the column of one of 
the original variables, and the program would have access to the resulting ten 
variables for Its analysis. In this specific Instance, the program would exit because 
of a singularity. 

2.5.2 Notes on Correlation and Eigen Analysis 

The regression and factor analysis programs contain options that, in proper combination, 
cause program termination when the correlation matrix and the latent roots and vectors 
have been calculated. For example, the "no print" option (cc 25-26 of the option card) 
used with the option for printing the correlation matrix gives this facility in the 
regression program. 

With the matrix input option to factor analysis, and using option 2 for the number of 
factors, rotation option 0, and communallty option 0, eigenvalues of matrices can be 
obtained. However, the number of eigenvectors is limited to ten, the maximum number 
of rotatable factors. 
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2.5.3 Punched Matrix Output 



Matrix Number 


Dimension 


1 


Nx N 


2 


Nx N 


3 


Nx N 


4 


N X N 


5 


Nx N 


6 


NxK 


7 


Kx K 


8 


NxK 


9 


KxK 


10 


NxK 


11 


KxK 


12 


NxK 


13 


KxK 


14 


NxK 


15 


KxK 


16 


NxK 


17 


NxK 


21 


1x1 



Name 

Raw cross products matrix 

Adjusted cross products matrix 

Variance-covariance matrix 

Correlation coefficients matrix 

Characteristic vectors 

Principal axis factor matrix 

Orthogonal transformation matrix 

Orthogonal factor matrix 

Transformation to oblique reference structure matrix 

Oblique reference vector structure matrix 

Correlations among oblique reference vectors 

Oblique reference vector pattern matrix 

Correlations between reference vectors and primary 
factors 

Oblique primary factor structure matrix 

Correlations among oblique primary factors 

Oblique primary factor pattern matrix 

Factor score regression coefficients 

Number of cases 



The following matrices include two or three vectors, which are punched as column 
vectors where the column dimension indicates the number of elements in the vector. 



Meaning 







No. of Elements 


Matrix Number 


Dimension 


on Each Card 


22 


Nx 2 


2 


23 


Nx 2 


2 


24 


*N X 3 


3 


the above : N = 


number of variables 



K = number of rotated factors 
*N = order of the polynomial 



Raw sums, raw sums of squares 

Means, standard deviations 

Alpha, Beta, C (orthogonal 
polynomial solution vectors) 
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2.5.4 Scaling 

The programs in the 1130 Statistical System allow large data sets and a general input 
format. Thus, there is a possibility that scaling will be necessary. 

In regression and factor analysis, a pooling option is allowed that uses the raw cross 
products matrix. If the number of observations is large, or if some observed variable 
readings are quite large, some inaccuracies may become evident in this matrix. 
Sometimes, scaling by use of the Format statement can aid in the solution of this 
problem. In other situations, a transformation of the variable may help. It is also 
possible that scaling should take place before data entry. 

In orthogonal polynomials, if the order of the polynomial is high, and/or the range of 
X is large, the elements of the polynomials will change rapidly in magnitude (as the 
order of the polynomial increases) so as to even exceed the range of the floating-point 
number, resulting in underflow or overflow. If data entered into this program is such 
that this happens, as evidenced, for example, by the residuals, the user can elect to 
transform or scale the dependent and/or independent variables. A useful option in this 
program automatically scales the independent variable into a range such that the 
magnitudes of the successive polynomial elements are approximately uniform. 

In summary, the programs in this system are data-dependent , as is the case for many 
computer programs. In some programs, definite accuracy characteristics can be 
stated. In data-dependent routines, these statements are difficult to make. 
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CHAPTER 3: GENERAL FLOWCHARTS 

The following charts (Figures 17, 18, 19) describe, generally, the programs in this 
package. More detailed flowcharts, and listings, are available in the Systems Manual 
for this package. The Systems Manual is not distributed with this program unless 
specifically requested. 



Analysis of Variance — System Flow 



Stepwise Multiple Regression — ^stem Flow 



VRead and Print/ 
Control 
Cards 



Input 

Source 

Data 



Compute 
Deviates and 
Mean Squares 



Generate 
ANOVA 
Table 



(^ 



\ReadandPrlnty 
\ Control 
\ Cords 



Input Source 

JJatp. 

Form Cross 
Products 




Form Subsidi- 
ary and Cor- 
relation 
Matrices 



Perform 
Complete 
Regression 
Analysis 



tS" 




Figure 17. Analysis of variance and stepwise multiple regression 
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VRead and Print/ 
Control 
Cards 



Input 

Initial 

Data 



NO 



Compute 

Orthogonal 

Polynomials 




NO 



YES 



Compute 

Polynomial 

Coefficients 





YES 



Input 

Source 

Data 






Compute 

Predicted 

Values 



YES 



Compute 
Derivatives 



^ 



NO 




NO 



-^Exit) 



Figure 18. Curve fitting with orthogonal polynomials 
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V Read and Prinf 
Control 
Cards 



Input Source 

_Da_ta_ 

Form Cross 
Products 




YES 



Form Subsid- 
iary and 
Correlation 
Matrices 





NO 



M 



Perform 

Orthogonal 

Rotation 





YES 



Perform 

Oblique 

Rotation 



YES 



Compute 

Factor 

Scores 



^ 



NO 




NO 



Figure 19. Factor analysis 
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CHAPTEH 4: SAMPLE PROBLEM TIMING 

The table below gives times for each sample problem, from the reading of the first 
monitor card to the end of the output listing. 

The 1132 Printer was used as the output device. 

Time 

Problem (minrsec) 

Regression analysis (card ii^ut) 6:02 

Regression analysis (correlation matrix input) 3:04 

Orthogonal polynomials (card input, no scaling) 2:35 

Orthogonal polynomials (cards, scaling) 2-35 

Orthogonal polynomials (solution vector input, no scaling) 2:00 

Orthogonal polynomials (solution vector input, scaling) 2:00 

Analysis of variance 2-14 

Principal components analysis (card input) 5:48 

Factor analysis (correlation matrix input) 3:45 
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CHAPTER 5: ERROR MESSAGES 

Following is a list of error messages presented to the user on the (optional) printer or 
the typewriter: 

Common to All Programs 

1. AN ILLEGAL CHARACTER HAS BEEN ENCOUNTERED IN COLUMN (N) OF THE 
ABOVE FORMAT CARD. CHANGE CARD AND RERUN JOB. 

Action: Correct the format card and rerun the job. See section 1.2 (Variable Format Card). 

2. AN ILLEGAL CHARACTER HAS BEEN ENCOUNTERED IN APPROXIMATELY 
COLUMN (N) OF THE ABOVE DATA CARD. CHANGE CARD AND RERUN JOB. 

Action: The format card and/or the data card is in error. Correct the card(s) and 
rerun the job. See sections 1.3(1) and 1.2 (Variable Format Card), and the 
data input section pertaining to the particular analysis being run. 

3. INVALID INPUT OPTION. JOB TERMINATED. 

Action: Data input mode is not 01, 02, or 03. See the section discussing the option 
card (irq)ut mode) for the particular analysis being run. 

Common to Regression and Factor Analysis 

4. CARD (ID) IS OUT OF SEQUENCE. RERUN JOB. 

Action: Check sequence number of card, revise, and rerun job. See section 2. 1.3 
or 2.2.5. 

Regression Messages 

5. MEAN SQUARE NONPOSITIVE. JOB TERMINATED. 

Action: A format specification error could have caused data to be converted 
incorrectly, or an ill-conditioned matrix (for example, one with high 
correlations between independent variables) could have caused inaccuracy 
in the inversion of the correlation matrix or in the calculation of mean 
squares. 

6. NO MORE DEGREES OF FREEDOM. JOB TERMINATED. 

Action: The number of parameters being estimated is larger than the number of 

observations. Increase the number of observations, or accept a model with 
fewer parameters. 

7. NO MORE VARIABLES SATISFY THE VARIANCE CRITERION. JOB TERMINATED. 

Action: Modify the variance criterion (section 2. 1. 2), or accept one of the models 
produced. 
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